-- Logs begin at Mon 2022-08-01 15:53:27 UTC, end at Mon 2022-08-01 17:20:07 UTC. -- Aug 01 16:48:38.852378 dv-cinder-850321-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 16:48:38.861105 dv-cinder-850321-2-smb devstack@keystone.service[80240]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 16:48:38 2022] *** Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: nodename: dv-cinder-850321-2-smb Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: machine: x86_64 Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: clock source: unix Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: pcre jit disabled Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: detected number of CPU cores: 4 Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: current working directory: / Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: detected binary path: /usr/bin/uwsgi-core Aug 01 16:48:38.863037 dv-cinder-850321-2-smb devstack@keystone.service[80240]: your processes number limit is 47680 Aug 01 16:48:38.863724 dv-cinder-850321-2-smb devstack@keystone.service[80240]: your memory page size is 4096 bytes Aug 01 16:48:38.863724 dv-cinder-850321-2-smb devstack@keystone.service[80240]: detected max file descriptor number: 2048 Aug 01 16:48:38.863724 dv-cinder-850321-2-smb devstack@keystone.service[80240]: lock engine: pthread robust mutexes Aug 01 16:48:38.863724 dv-cinder-850321-2-smb devstack@keystone.service[80240]: thunder lock: enabled Aug 01 16:48:38.863724 dv-cinder-850321-2-smb devstack@keystone.service[80240]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 16:48:38.863724 dv-cinder-850321-2-smb devstack@keystone.service[80240]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 16:48:38.903052 dv-cinder-850321-2-smb devstack@keystone.service[80240]: Python main interpreter initialized at 0x55d0ccb429c0 Aug 01 16:48:38.903052 dv-cinder-850321-2-smb devstack@keystone.service[80240]: python threads support enabled Aug 01 16:48:38.903052 dv-cinder-850321-2-smb devstack@keystone.service[80240]: your server socket listen backlog is limited to 100 connections Aug 01 16:48:38.903052 dv-cinder-850321-2-smb devstack@keystone.service[80240]: your mercy for graceful operations on workers is 90 seconds Aug 01 16:48:38.903386 dv-cinder-850321-2-smb devstack@keystone.service[80240]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 16:48:38.903482 dv-cinder-850321-2-smb devstack@keystone.service[80240]: *** Operational MODE: preforking *** Aug 01 16:48:38.903759 dv-cinder-850321-2-smb devstack@keystone.service[80240]: *** uWSGI is running in multiple interpreter mode *** Aug 01 16:48:38.903759 dv-cinder-850321-2-smb devstack@keystone.service[80240]: spawned uWSGI master process (pid: 80240) Aug 01 16:48:38.903950 dv-cinder-850321-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 01 16:48:38.905770 dv-cinder-850321-2-smb devstack@keystone.service[80240]: spawned uWSGI worker 1 (pid: 80252, cores: 1) Aug 01 16:48:38.905770 dv-cinder-850321-2-smb devstack@keystone.service[80240]: spawned uWSGI worker 2 (pid: 80253, cores: 1) Aug 01 16:48:38.905770 dv-cinder-850321-2-smb devstack@keystone.service[80240]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 16:48:44.438595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:48:44.438595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: from cryptography.utils import int_from_bytes Aug 01 16:48:44.439394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:48:44.439394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Aug 01 16:48:44.439840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:48:44.439840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: from cryptography.utils import int_from_bytes Aug 01 16:48:44.439977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:48:44.439977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Aug 01 16:48:44.489788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:48:44.489973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:48:44.490161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] command line args: [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:48:44.490400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:48:44.490491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:48:44.490606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:48:44.490732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ================================================================================ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:48:44.490898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] command line args: [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:48:44.491004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] admin_token = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.491147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config_dir = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.491227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:48:44.491341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.491426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ================================================================================ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:48:44.491524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config_source = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.491610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.491707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] debug = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.491842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_dir = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.491925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_source = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] debug = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.492995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_config_append = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_dir = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.493885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_config_append = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_dir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.494994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.495932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496253 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.496960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.497121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.497221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.497370 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.497472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.497626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.497887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.121/identity {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.497985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] publish_errors = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.121/identity {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498546 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] publish_errors = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.498979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] standard_threads = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] standard_threads = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.499985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_journal = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_json = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_stderr = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_syslog = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_journal = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_json = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.500981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.501085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_stderr = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.501194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.501278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_syslog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.501443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.501521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:48:44.501708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.501785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.501950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.502969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.503952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.504932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.505999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.506159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.506235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.506959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.507952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508269 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.508989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.509939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.510985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.511956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.512108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.512196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.512266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.512336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.512506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.512595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.513955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.514930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.515981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.516958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.517992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.518996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.519919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520253 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.520968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.521922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.522705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.522970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.522970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.523964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.524899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.525999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.526078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.526234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.526374 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.526511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.526589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.526752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.526829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.external = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.527972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.external = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.password = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.528953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.token = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.password = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.token = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.529989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.530984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.531982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.532949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.533955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.534144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.534232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.534416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.534495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.534683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.534759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.534920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535160 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.535964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.536950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537441 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.537976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.538957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.539919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.540876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.541854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.542879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.543982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.544952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.545951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.546077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.546201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.546386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.546509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.546633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.546768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.546901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.547899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.548898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.549923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.550920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.551908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.552893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.553980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.554912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.555146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.555269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.555392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.555511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.555637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.555762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.555882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.556887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557635 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.557965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.558966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.559955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.560939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.561905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.562025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.562145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.562317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.562514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.562640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.562764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.562887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.563887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.564906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.565890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566141 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566141 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.566894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567240 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.567984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.568105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.568224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.568354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.568734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.569334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.569454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.569575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.569695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.569824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.569949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.570998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571251 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.571996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.572130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.572254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.572377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.572501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.572620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.572752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.572877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.573944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.574932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.575912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.576900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.577776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.578882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.579910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.580920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:48:44.581040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.581040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.581040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.581040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:48:44.581040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:48:44.607904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.608137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.608365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.608713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.608952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.609184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.616784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.617571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.647909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.648167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.648326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.648482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.700484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.700673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.750687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.750921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.751249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.751491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.816787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.817037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.817179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.817312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.817463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.817590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.817728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.817868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.818000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.818124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.818248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.818407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.842916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.843062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.843145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.843279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.843363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.843494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.843576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.854555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.854774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.867733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.867973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.868873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.869012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.869096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.869235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.869453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 16:48:44.887047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.887047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:48:44.887323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.887460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.887594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:48:44.887986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:48:44.888123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.888266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.888398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 16:48:44.888529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.888659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.888797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.888930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.889060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.898367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.898649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.898809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.898956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.899085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.899216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.899357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.899623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.906112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.906689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.910916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.911200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.911486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.911629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.911762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.911892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.912930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.913116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.913199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.913392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.913483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.913667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.913749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.913942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.914213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.937159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.937984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.938689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.938974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.939512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.939803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.943637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.944496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.944766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.945028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.945312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.945600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.951505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.951743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.952421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.952708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.956037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.956328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.956612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.956898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.957009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.957173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.957308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.957464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.957593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.957743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.957878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.958023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.958159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.958472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.958763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.959036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.974057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.974365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.975189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.975471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.978340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.979434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.981522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.981823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.982815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.983116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.986252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.987542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.989463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.991301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:44.993270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.993572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.993871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.994162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.994480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.994562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.994770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.994864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.995079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.995372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.995652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:44.995945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.011450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.011732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.012004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.012278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.013018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.013305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.013578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.013856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.019499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.020827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.021056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.021335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.022443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.022723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.024228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.024512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.024810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.025112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.025395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.025559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.025843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.026144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.026481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.026766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.036891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.037173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.037455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.037761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.038041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.038308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.038423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.038595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.038684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.038878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.039163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.039447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.039726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.040001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.054799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.056309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.057771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.059415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.060775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.062421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.063250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.064768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.064876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.065051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.065332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.066409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.066704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.067012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.072419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.074032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.074523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.076147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.077000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.077294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.077581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.077873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.079122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.079416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.079703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.079993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.085997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.086311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.086607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.088161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.088451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.088736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.093472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.093753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.094035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.094349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.094628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.094911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.095193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.095469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.095758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 16:48:45.095849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.096981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.097168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.097294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.097442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.097710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.098085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.098455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.098755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.099046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.099320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.099587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 16:48:45.131392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d0ccb429c0 pid: 80252 (default app) Aug 01 16:48:45.134554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d0ccb429c0 pid: 80253 (default app) Aug 01 16:48:45.135210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76586c-db6a-4ccb-a6da-54bc58cc064c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:45.135503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76586c-db6a-4ccb-a6da-54bc58cc064c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:45.135787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76586c-db6a-4ccb-a6da-54bc58cc064c None None] PATH_INFO: `/v3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:45.140469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1/1] 10.222.0.121 () {50 vars in 796 bytes} [Mon Aug 1 16:48:45 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:48:52.797225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38335-ad20-45e1-91f4-08b07130edad None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:52.797788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38335-ad20-45e1-91f4-08b07130edad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:52.797788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38335-ad20-45e1-91f4-08b07130edad None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:52.802229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1/2] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:48:52 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:48:52.808133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:52.808713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:52.809034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:52.880642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: INFO dbcounter [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] Registered counter for database keystone Aug 01 16:48:52.900172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG oslo_db.sqlalchemy.engines [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:48:52.906504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writer thread running {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:48:53.086684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG passlib.handlers.bcrypt [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80252) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 16:48:53.087013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG passlib.handlers.bcrypt [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80252) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 16:48:53.141771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:48:53.143418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:48:53.273520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 2/3] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:48:52 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 01 16:48:53.409417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead38335-ad20-45e1-91f4-08b07130edad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:53.481830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: INFO dbcounter [None req-ead38335-ad20-45e1-91f4-08b07130edad None None] Registered counter for database keystone Aug 01 16:48:53.503014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG oslo_db.sqlalchemy.engines [None req-ead38335-ad20-45e1-91f4-08b07130edad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:48:53.509604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writer thread running {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:48:53.629666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead38335-ad20-45e1-91f4-08b07130edad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:53.634435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576f66-4b57-4874-b967-50a942ecf9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:53.635068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576f66-4b57-4874-b967-50a942ecf9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:53.635351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576f66-4b57-4874-b967-50a942ecf9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:53.635629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576f66-4b57-4874-b967-50a942ecf9e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:53.643977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576f66-4b57-4874-b967-50a942ecf9e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:53.696186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0576f66-4b57-4874-b967-50a942ecf9e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 16:48:53.696527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0576f66-4b57-4874-b967-50a942ecf9e7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:53.706090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 2/4] 10.222.0.121 () {58 vars in 1329 bytes} [Mon Aug 1 16:48:53 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 16:48:53.712694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:53.726843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cd6a5-5b2b-4877-a33a-22f3ffe3be58 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:53.731454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551704a-b41c-420e-b540-d075f51fdb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:53.732590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551704a-b41c-420e-b540-d075f51fdb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:53.732882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551704a-b41c-420e-b540-d075f51fdb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:53.733161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551704a-b41c-420e-b540-d075f51fdb5f admin admin] PATH_INFO: `/v3/projects/af3932992b7744cba48da1d3cbe4b99c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:53.734701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551704a-b41c-420e-b540-d075f51fdb5f admin admin] RBAC: Authorizing `identity:get_project(project_id=af3932992b7744cba48da1d3cbe4b99c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:53.786776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1551704a-b41c-420e-b540-d075f51fdb5f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 16:48:53.787124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551704a-b41c-420e-b540-d075f51fdb5f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:53.791764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 3/5] 10.222.0.121 () {56 vars in 1212 bytes} [Mon Aug 1 16:48:53 2022] GET /identity/v3/projects/af3932992b7744cba48da1d3cbe4b99c => generated 345 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:48:55.794540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ee8d-f1b9-4590-bfc1-5d7490cc58f7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:55.795096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ee8d-f1b9-4590-bfc1-5d7490cc58f7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:55.795096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9ee8d-f1b9-4590-bfc1-5d7490cc58f7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:55.799217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 3/6] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:48:55 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:48:55.804866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f356e-dfd4-408d-9c2f-afddfe55802f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:55.805244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f356e-dfd4-408d-9c2f-afddfe55802f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:55.805440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f356e-dfd4-408d-9c2f-afddfe55802f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:55.825718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-443f356e-dfd4-408d-9c2f-afddfe55802f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:48:55.827270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-443f356e-dfd4-408d-9c2f-afddfe55802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:48:55.835906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 4/7] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:48:55 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 16:48:55.858500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9ee8d-f1b9-4590-bfc1-5d7490cc58f7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:55.870423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9ee8d-f1b9-4590-bfc1-5d7490cc58f7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:55.874590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69bcf6-f9d4-4e8d-95ee-e53da18ba57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:55.875200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bcf6-f9d4-4e8d-95ee-e53da18ba57f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:55.875486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bcf6-f9d4-4e8d-95ee-e53da18ba57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:55.875762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69bcf6-f9d4-4e8d-95ee-e53da18ba57f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:55.883989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bcf6-f9d4-4e8d-95ee-e53da18ba57f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:55.885778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69bcf6-f9d4-4e8d-95ee-e53da18ba57f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:55.895005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 4/8] 10.222.0.121 () {58 vars in 1329 bytes} [Mon Aug 1 16:48:55 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:48:55.901112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f356e-dfd4-408d-9c2f-afddfe55802f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:55.910349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f356e-dfd4-408d-9c2f-afddfe55802f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:55.914827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d1ed6-eaba-4c78-9702-c61da405082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:55.915492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1ed6-eaba-4c78-9702-c61da405082b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:55.915781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1ed6-eaba-4c78-9702-c61da405082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:55.916065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d1ed6-eaba-4c78-9702-c61da405082b admin admin] PATH_INFO: `/v3/users/754ebcbafca74603b46f7997fa570165` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:55.917456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d1ed6-eaba-4c78-9702-c61da405082b admin admin] RBAC: Authorizing `identity:get_user(user_id=754ebcbafca74603b46f7997fa570165)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:55.920363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d1ed6-eaba-4c78-9702-c61da405082b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:55.921919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 5/9] 10.222.0.121 () {56 vars in 1203 bytes} [Mon Aug 1 16:48:55 2022] GET /identity/v3/users/754ebcbafca74603b46f7997fa570165 => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:48:57.984372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13196a7-c245-4b9a-9c17-9621fb13d620 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:57.984901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13196a7-c245-4b9a-9c17-9621fb13d620 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:57.984989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13196a7-c245-4b9a-9c17-9621fb13d620 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:57.986389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 5/10] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:48:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:48:57.992184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627bb2-2c36-4ef0-a609-2154d2797f0d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:57.992587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627bb2-2c36-4ef0-a609-2154d2797f0d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:57.992818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627bb2-2c36-4ef0-a609-2154d2797f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:57.996725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93133016-c19b-41c1-887d-00a6cf2cbeb9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:57.997011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93133016-c19b-41c1-887d-00a6cf2cbeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:57.997293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93133016-c19b-41c1-887d-00a6cf2cbeb9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:57.998581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 6/11] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:48:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:48:58.003697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.003986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.004267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.012203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ef627bb2-2c36-4ef0-a609-2154d2797f0d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:48:58.013648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ef627bb2-2c36-4ef0-a609-2154d2797f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:48:58.046417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80253) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 16:48:58.046854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80253) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 16:48:58.092155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:48:58.093782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:48:58.094229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 6/12] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:48:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:48:58.118509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef627bb2-2c36-4ef0-a609-2154d2797f0d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.141955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:58.195485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 7/13] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:48:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:48:58.216711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.221736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef627bb2-2c36-4ef0-a609-2154d2797f0d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.257390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.258043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.258360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.258646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.270137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:48:58.279680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:48:58.280768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:48:58.281789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 7/14] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:48:58.286937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.317238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef4e89-9118-444b-b20f-9e7967ed7f87 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.320094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:58.355664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.356538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.356830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.357112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.369185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:58.389184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f698ab-114d-415c-8d1e-c1e59e0826b6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.424242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.424866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.425152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.425433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.425527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:58.426163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:48:58.426505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:58.427002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:58.427889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:58.440414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 8/15] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:48:58.446511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.525303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 8/16] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:48:58.531053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.533672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:58.546164 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857bbf3-c791-457a-b311-7350a8c09d29 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.635152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c3e2b-b83f-4ba8-ab00-d7b049fa9ecc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.672923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.673798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.674090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.674445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.687943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.688588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.688870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.689147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] PATH_INFO: `/v3/users/754ebcbafca74603b46f7997fa570165` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.690355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] RBAC: Authorizing `identity:get_user(user_id=754ebcbafca74603b46f7997fa570165)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:58.691806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:58.692418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:58.693391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 9/17] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/users/754ebcbafca74603b46f7997fa570165 => generated 248 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:48:58.693903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:58.699037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:48:58.712364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:48:58.713216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:48:58.714217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:48:58.714217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:48:58.714217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:48:58.714217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:48:58.714217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 9/18] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:48:58.714672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:58.719213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.774922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:58.801293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03432b19-943f-48cc-971a-5b7be0b7d717 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.817203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb320a26-f63c-429a-996d-278b53f94e23 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.836080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.836724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.837005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.837280 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.838468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:58.840048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:58.841612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 10/19] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:48:58.847267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:48:58.851028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775db225-88dd-47c2-8a1f-40a79e5f4472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.851656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775db225-88dd-47c2-8a1f-40a79e5f4472 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.851941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775db225-88dd-47c2-8a1f-40a79e5f4472 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.852222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775db225-88dd-47c2-8a1f-40a79e5f4472 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.852921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775db225-88dd-47c2-8a1f-40a79e5f4472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:48:58.853228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775db225-88dd-47c2-8a1f-40a79e5f4472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:58.854646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775db225-88dd-47c2-8a1f-40a79e5f4472 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:58.871966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 10/20] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:48:58.934101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:58.954566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f863e-a677-42a3-9540-e3840346e871 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:48:58.989566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf37bd6-9f7b-496b-ab8f-61fac0ece9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:48:58.990207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37bd6-9f7b-496b-ab8f-61fac0ece9db None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:48:58.990524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37bd6-9f7b-496b-ab8f-61fac0ece9db None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:48:58.991364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37bd6-9f7b-496b-ab8f-61fac0ece9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:48:58.992182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf37bd6-9f7b-496b-ab8f-61fac0ece9db None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.domain.id=default, user.id=754ebcbafca74603b46f7997fa570165) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:48:58.992496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf37bd6-9f7b-496b-ab8f-61fac0ece9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:48:58.993952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf37bd6-9f7b-496b-ab8f-61fac0ece9db None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:48:59.001339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 11/21] 10.222.0.121 () {56 vars in 1327 bytes} [Mon Aug 1 16:48:58 2022] GET /identity/v3/role_assignments?user.id=754ebcbafca74603b46f7997fa570165&scope.domain.id=default&role.id=0b911707f2884d61bd847b72d704811f => generated 234 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:01.318372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a0b06-0894-43be-a3b7-89e3e201ef17 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:01.319411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a0b06-0894-43be-a3b7-89e3e201ef17 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:01.319483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a0b06-0894-43be-a3b7-89e3e201ef17 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:01.321114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 11/22] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:01.326632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413a47-6d9a-4566-b20f-3fb1ee7a6148 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:01.327032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413a47-6d9a-4566-b20f-3fb1ee7a6148 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:01.327212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413a47-6d9a-4566-b20f-3fb1ee7a6148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:01.351353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f5413a47-6d9a-4566-b20f-3fb1ee7a6148 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:01.352616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5413a47-6d9a-4566-b20f-3fb1ee7a6148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:01.449008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 12/23] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:01.479086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a0b06-0894-43be-a3b7-89e3e201ef17 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:01.488880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba60d9b-abb0-4488-985e-50438d5a9be8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:01.489163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba60d9b-abb0-4488-985e-50438d5a9be8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:01.489447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba60d9b-abb0-4488-985e-50438d5a9be8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:01.494069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 13/24] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:01 2022] GET /identity => generated 271 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:01.497826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a75f-2fba-4394-96e6-c6b6452714aa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:01.498113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a75f-2fba-4394-96e6-c6b6452714aa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:01.498441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35a75f-2fba-4394-96e6-c6b6452714aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:01.519338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-bc35a75f-2fba-4394-96e6-c6b6452714aa None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:01.520525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bc35a75f-2fba-4394-96e6-c6b6452714aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:01.621465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a0b06-0894-43be-a3b7-89e3e201ef17 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:01.625095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 14/25] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:01.642810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:01.663841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35a75f-2fba-4394-96e6-c6b6452714aa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:01.674610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:01.682725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd86e-ad52-40b2-9c6c-a388e3fe5443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:01.683323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd86e-ad52-40b2-9c6c-a388e3fe5443 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:01.683610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd86e-ad52-40b2-9c6c-a388e3fe5443 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:01.683891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd86e-ad52-40b2-9c6c-a388e3fe5443 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:01.684640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bd86e-ad52-40b2-9c6c-a388e3fe5443 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:01.686036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bd86e-ad52-40b2-9c6c-a388e3fe5443 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:01.869364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35a75f-2fba-4394-96e6-c6b6452714aa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:01.977124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:01.977791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:01.978082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:01.978392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.002407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:02.006561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 12/26] 10.222.0.121 () {60 vars in 1136 bytes} [Mon Aug 1 16:49:01 2022] POST /identity/v3/roles => generated 220 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:02.013092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319acf4b-a1db-4695-b0e2-c47264b0814d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.013092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319acf4b-a1db-4695-b0e2-c47264b0814d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.013092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319acf4b-a1db-4695-b0e2-c47264b0814d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.013092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 13/27] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:02.013447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:02.014219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:02.015002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 15/28] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:02.026599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d428-f7a6-42d6-af99-918003b60e03 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.026894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d428-f7a6-42d6-af99-918003b60e03 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.027173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990d428-f7a6-42d6-af99-918003b60e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.029448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:02.079214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5990d428-f7a6-42d6-af99-918003b60e03 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:02.080801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5990d428-f7a6-42d6-af99-918003b60e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:02.214655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:02.245873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 14/29] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:02.261564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc99082-c5e3-4705-be4c-52a908f8df3a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:02.270418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d428-f7a6-42d6-af99-918003b60e03 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:02.307722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:02.308611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.308939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.309221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.309956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:02.310280 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:02.311686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:02.334337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 16/30] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:02.335942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:02.434851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990d428-f7a6-42d6-af99-918003b60e03 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:02.443001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:02.470739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc8b54-f5ba-4e5b-bfea-93112028649e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:02.473344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e0625-3974-4d98-a2b9-28b606091c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:02.474134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e0625-3974-4d98-a2b9-28b606091c27 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.474485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e0625-3974-4d98-a2b9-28b606091c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.475279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e0625-3974-4d98-a2b9-28b606091c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.486037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e0625-3974-4d98-a2b9-28b606091c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:02.488021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e0625-3974-4d98-a2b9-28b606091c27 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:02.499284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e27e0625-3974-4d98-a2b9-28b606091c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:49:02.503759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:02.504562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:02.505366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:49:02.505366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:49:02.505366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:49:02.505366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:02.505366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 15/31] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:02.506309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5110-5950-4fad-9fb7-264d0a3416a3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.506546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5110-5950-4fad-9fb7-264d0a3416a3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.506996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e5110-5950-4fad-9fb7-264d0a3416a3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.513065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 16/32] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:02.513065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31fa4-994d-4f4f-94de-b2541b17e02a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.513065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31fa4-994d-4f4f-94de-b2541b17e02a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.513065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b31fa4-994d-4f4f-94de-b2541b17e02a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.513065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 17/33] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:02.513065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b31fa4-994d-4f4f-94de-b2541b17e02a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:02.519377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab219e-dba1-4c62-885f-cb26b928ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:02.520229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab219e-dba1-4c62-885f-cb26b928ddaa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.520522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab219e-dba1-4c62-885f-cb26b928ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.520809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab219e-dba1-4c62-885f-cb26b928ddaa None admin] PATH_INFO: `/v3/users/754ebcbafca74603b46f7997fa570165` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.522502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab219e-dba1-4c62-885f-cb26b928ddaa None admin] RBAC: Authorizing `identity:get_user(user_id=754ebcbafca74603b46f7997fa570165)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:02.524325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab219e-dba1-4c62-885f-cb26b928ddaa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:02.526325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 17/34] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:02 2022] GET /identity/v3/users/754ebcbafca74603b46f7997fa570165 => generated 248 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:02.530287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569dafd-e85e-4d4f-a8ec-ab78f860385a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.530287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569dafd-e85e-4d4f-a8ec-ab78f860385a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.530287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569dafd-e85e-4d4f-a8ec-ab78f860385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.548665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9569dafd-e85e-4d4f-a8ec-ab78f860385a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:02.549894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9569dafd-e85e-4d4f-a8ec-ab78f860385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:02.622913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b31fa4-994d-4f4f-94de-b2541b17e02a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:02.631515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 18/35] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:02.631515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c47e-2437-4e3b-82d2-b85fa7a61e99 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.631515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c47e-2437-4e3b-82d2-b85fa7a61e99 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.631515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c47e-2437-4e3b-82d2-b85fa7a61e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.645107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7163c47e-2437-4e3b-82d2-b85fa7a61e99 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:02.646323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7163c47e-2437-4e3b-82d2-b85fa7a61e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:02.666763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:02.667397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.667683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.667968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.668672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:02.668981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:02.670407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:02.683712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 18/36] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:49:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:02.684736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:02.705834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:02.715918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 19/37] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:02.727777 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0c32-4dba-41d8-9d86-809a414ba80e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.728071 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0c32-4dba-41d8-9d86-809a414ba80e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.728359 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0c32-4dba-41d8-9d86-809a414ba80e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.730287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 20/38] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:02.731051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0c32-4dba-41d8-9d86-809a414ba80e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:02.790796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:02.791366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893442c-f28e-48e6-9f02-5912c15b9d01 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:02.825003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:02.825657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.825948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.826237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.827693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:02.829148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:02.830793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 19/39] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:02 2022] GET /identity/v3/domains/default => generated 200 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:02.831547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:02.839966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0c32-4dba-41d8-9d86-809a414ba80e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:02.876205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb881-b1d6-4054-8251-a856ef154447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:02.876828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb881-b1d6-4054-8251-a856ef154447 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.877115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb881-b1d6-4054-8251-a856ef154447 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.877396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb881-b1d6-4054-8251-a856ef154447 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.878115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb881-b1d6-4054-8251-a856ef154447 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:02.879618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb881-b1d6-4054-8251-a856ef154447 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:02.923477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:02.939706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a1511-069b-4577-8050-8e03fb562436 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:02.971987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:02.972636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:02.972923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:02.973203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:02.973880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:02.975765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:03.003723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 21/40] 10.222.0.121 () {60 vars in 1136 bytes} [Mon Aug 1 16:49:02 2022] POST /identity/v3/roles => generated 224 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:03.005184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695284c-23a5-4e63-9a17-13ef6baa57b7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:03.005539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695284c-23a5-4e63-9a17-13ef6baa57b7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:03.005825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695284c-23a5-4e63-9a17-13ef6baa57b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:03.018332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 20/41] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:49:02 2022] POST /identity/v3/projects => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:03.018332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:03.033767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3695284c-23a5-4e63-9a17-13ef6baa57b7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:03.035588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3695284c-23a5-4e63-9a17-13ef6baa57b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:03.119910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 22/42] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:03.120910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695284c-23a5-4e63-9a17-13ef6baa57b7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:03.155054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf501224-5959-40fd-be5d-d63bd16a5098 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:03.180082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:03.205458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:03.206640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:03.206938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:03.207230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:03.207985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:03.209451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:03.223897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:03.228849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 21/43] 10.222.0.121 () {60 vars in 1136 bytes} [Mon Aug 1 16:49:03 2022] POST /identity/v3/roles => generated 226 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:03.229661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:03.255419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695284c-23a5-4e63-9a17-13ef6baa57b7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:03.304204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:03.305096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:03.305387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:03.306080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] PATH_INFO: `/v3/domains/default/users/754ebcbafca74603b46f7997fa570165/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:03.309853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=754ebcbafca74603b46f7997fa570165, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:03.312067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:03.334024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 23/44] 10.222.0.121 () {58 vars in 1366 bytes} [Mon Aug 1 16:49:03 2022] PUT /identity/v3/domains/default/users/754ebcbafca74603b46f7997fa570165/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:03.359064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbd821-4dff-4a5d-acce-52e51fb42f1c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:03.400994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8db32-e49e-492e-b832-c57ba7f6bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:03.401667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8db32-e49e-492e-b832-c57ba7f6bdba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:03.401951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8db32-e49e-492e-b832-c57ba7f6bdba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:03.402227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8db32-e49e-492e-b832-c57ba7f6bdba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:03.403674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8db32-e49e-492e-b832-c57ba7f6bdba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:03.405150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8db32-e49e-492e-b832-c57ba7f6bdba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:03.406872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 22/45] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:03.415720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:03.538582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828206af-ab7a-4ed5-a2b0-7b012465ffd1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:03.540793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:03.573134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97543c1-735b-4cbe-8961-fcb51ca7e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:03.573761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97543c1-735b-4cbe-8961-fcb51ca7e5ae None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:03.574047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97543c1-735b-4cbe-8961-fcb51ca7e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:03.574353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97543c1-735b-4cbe-8961-fcb51ca7e5ae None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:03.575040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97543c1-735b-4cbe-8961-fcb51ca7e5ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:03.576482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97543c1-735b-4cbe-8961-fcb51ca7e5ae None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:03.604253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 24/46] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:49:03 2022] POST /identity/v3/projects => generated 313 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:05.333867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df8d73-fe80-4c63-b04e-4bacb10438f1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.334434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df8d73-fe80-4c63-b04e-4bacb10438f1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.334536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df8d73-fe80-4c63-b04e-4bacb10438f1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.335826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 23/47] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:05.340910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab1a2-615e-4766-86c8-0bd760766051 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.341323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab1a2-615e-4766-86c8-0bd760766051 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.341487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab1a2-615e-4766-86c8-0bd760766051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.359667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c8dab1a2-615e-4766-86c8-0bd760766051 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:05.360880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c8dab1a2-615e-4766-86c8-0bd760766051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:05.426835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 25/48] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:05.450608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df8d73-fe80-4c63-b04e-4bacb10438f1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:05.517374 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:05.552353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df8d73-fe80-4c63-b04e-4bacb10438f1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:05.586126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:05.586726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.587013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.587295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.598818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:05.600242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1022-30c5-4517-8ab6-2148a7365e06 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.600540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1022-30c5-4517-8ab6-2148a7365e06 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.600820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1022-30c5-4517-8ab6-2148a7365e06 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.602227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 26/49] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:05.605561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:05.606419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:05.607187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 24/50] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:05.607798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b515fb-d2bc-4c1d-b282-396176508beb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.607798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b515fb-d2bc-4c1d-b282-396176508beb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.607798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b515fb-d2bc-4c1d-b282-396176508beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.612256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:05.627469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e9b515fb-d2bc-4c1d-b282-396176508beb None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:05.628680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e9b515fb-d2bc-4c1d-b282-396176508beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:05.696748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 27/51] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:05.711475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142bda-56e1-449b-8b6e-b6c2d29b0a27 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:05.718849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b515fb-d2bc-4c1d-b282-396176508beb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:05.736178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:05.737980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:05.747708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:05.748336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.748615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.748892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.749600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:05.749899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:05.751309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:05.764447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 25/52] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:05 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:05.769695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:05.820143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b515fb-d2bc-4c1d-b282-396176508beb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:05.855741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:05.856321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.856607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.856892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.858052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:05.859544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:05.861299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 28/53] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:05 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:05.867575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:05.868105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400bcd9-d125-4895-ba54-4c86536c9239 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:05.905910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:05.906606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:05.906895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:05.907167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] PATH_INFO: `/v3/users/754ebcbafca74603b46f7997fa570165` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:05.908599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] RBAC: Authorizing `identity:get_user(user_id=754ebcbafca74603b46f7997fa570165)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:05.910054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:05.911686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 26/54] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:05 2022] GET /identity/v3/users/754ebcbafca74603b46f7997fa570165 => generated 248 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:05.917548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:05.957370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:05.972362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:05.973689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e652478-2c06-4095-a572-492e957cf1b3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:06.007902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:06.008525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:06.008805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:06.009085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:06.009765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:06.011334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:06.017472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3f9a1-85f8-4fbe-a1c1-267e2c843222 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:06.038431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 29/55] 10.222.0.121 () {60 vars in 1145 bytes} [Mon Aug 1 16:49:05 2022] POST /identity/v3/projects => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:06.053189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59458051-7278-4e2a-8ab4-ea83615a7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:06.053871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458051-7278-4e2a-8ab4-ea83615a7c2a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:06.054154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458051-7278-4e2a-8ab4-ea83615a7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:06.054462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458051-7278-4e2a-8ab4-ea83615a7c2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:06.055713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59458051-7278-4e2a-8ab4-ea83615a7c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:06.057312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59458051-7278-4e2a-8ab4-ea83615a7c2a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:06.059038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 27/56] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:05 2022] GET /identity/v3/domains/default => generated 200 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:06.065279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:06.174432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aa6d5-0c43-42e7-b111-22fad2c92379 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:06.208449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be404ac8-7178-42af-8f49-62897276f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:06.209603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be404ac8-7178-42af-8f49-62897276f02c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:06.209895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be404ac8-7178-42af-8f49-62897276f02c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:06.210184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be404ac8-7178-42af-8f49-62897276f02c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:06.211020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be404ac8-7178-42af-8f49-62897276f02c None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.domain.id=default, user.id=754ebcbafca74603b46f7997fa570165) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:06.211332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be404ac8-7178-42af-8f49-62897276f02c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:06.212797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be404ac8-7178-42af-8f49-62897276f02c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:06.215697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:06.220045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 30/57] 10.222.0.121 () {56 vars in 1327 bytes} [Mon Aug 1 16:49:06 2022] GET /identity/v3/role_assignments?user.id=754ebcbafca74603b46f7997fa570165&scope.domain.id=default&role.id=0b911707f2884d61bd847b72d704811f => generated 532 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:08.070119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9140a-2981-4702-962d-17dc4353a7d7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:08.070654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9140a-2981-4702-962d-17dc4353a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:08.070738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9140a-2981-4702-962d-17dc4353a7d7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:08.072094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 28/58] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:08.077340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d357b-8d92-4193-ab95-ac30cbeeeed3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:08.077730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d357b-8d92-4193-ab95-ac30cbeeeed3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:08.077911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d357b-8d92-4193-ab95-ac30cbeeeed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:08.096611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-006d357b-8d92-4193-ab95-ac30cbeeeed3 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:08.097828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-006d357b-8d92-4193-ab95-ac30cbeeeed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:08.164810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 31/59] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:08.188274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9140a-2981-4702-962d-17dc4353a7d7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:08.286203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9140a-2981-4702-962d-17dc4353a7d7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:08.308549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:08.318849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe95c70-8843-4c49-be31-17315bdb42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:08.319494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95c70-8843-4c49-be31-17315bdb42ff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:08.319780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95c70-8843-4c49-be31-17315bdb42ff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:08.320059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95c70-8843-4c49-be31-17315bdb42ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:08.321212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe95c70-8843-4c49-be31-17315bdb42ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:08.322689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe95c70-8843-4c49-be31-17315bdb42ff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:08.324305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 29/60] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:08 2022] GET /identity/v3/domains/default => generated 200 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:08.329722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d357b-8d92-4193-ab95-ac30cbeeeed3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:08.429583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d357b-8d92-4193-ab95-ac30cbeeeed3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:08.457318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:08.463696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ecc7-cb0a-4791-8e86-c399b0e020ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:08.464323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ecc7-cb0a-4791-8e86-c399b0e020ca None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:08.464613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ecc7-cb0a-4791-8e86-c399b0e020ca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:08.464897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ecc7-cb0a-4791-8e86-c399b0e020ca None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:08.465596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ecc7-cb0a-4791-8e86-c399b0e020ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:08.467135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ecc7-cb0a-4791-8e86-c399b0e020ca None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:08.496356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 32/61] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:49:08 2022] POST /identity/v3/users => generated 276 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:11.383883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f310ed-7386-4cd1-a0ab-57ca1d66574f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:11.384735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f310ed-7386-4cd1-a0ab-57ca1d66574f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:11.385152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f310ed-7386-4cd1-a0ab-57ca1d66574f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:11.386809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 30/62] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:11.392532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db24a8-8721-48b6-9428-431fae996ed7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:11.393302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db24a8-8721-48b6-9428-431fae996ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:11.393726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db24a8-8721-48b6-9428-431fae996ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:11.418898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-00db24a8-8721-48b6-9428-431fae996ed7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:11.420340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-00db24a8-8721-48b6-9428-431fae996ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:11.516933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 33/63] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:11.555087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f310ed-7386-4cd1-a0ab-57ca1d66574f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:11.691077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f310ed-7386-4cd1-a0ab-57ca1d66574f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:11.741854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:11.742538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:11.742826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:11.743109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:11.755395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01db24-5c95-47de-afa0-7f7078932260 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:11.756013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01db24-5c95-47de-afa0-7f7078932260 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:11.756522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01db24-5c95-47de-afa0-7f7078932260 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:11.758524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 34/64] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:11.759262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:11.765347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:11.766198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:11.767017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:11.769869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 31/65] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:11.771830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a23a5-ee71-4978-83d2-76f719e52391 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:11.772351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a23a5-ee71-4978-83d2-76f719e52391 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:11.772831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a23a5-ee71-4978-83d2-76f719e52391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:11.776720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:11.804305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f71a23a5-ee71-4978-83d2-76f719e52391 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:11.807221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f71a23a5-ee71-4978-83d2-76f719e52391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:11.890144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:11.947959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1085cc0-0064-43a7-9fbd-8a3cf6f707d2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:11.955238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 35/66] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:11.984294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:11.985231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:11.985713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:11.986163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:11.987080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:11.987558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:11.988905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a23a5-ee71-4978-83d2-76f719e52391 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:11.989333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:11.998978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 32/67] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:11 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:12.007238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.048299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.110450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a23a5-ee71-4978-83d2-76f719e52391 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.130116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7948c-90ff-4769-a519-f5de62dedb4a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.145015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.146121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c32f-4678-4817-afed-4f0a68e90143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.147296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c32f-4678-4817-afed-4f0a68e90143 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.147587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c32f-4678-4817-afed-4f0a68e90143 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.147868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c32f-4678-4817-afed-4f0a68e90143 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.158665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38c32f-4678-4817-afed-4f0a68e90143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9a38c32f-4678-4817-afed-4f0a68e90143 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:12.164311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:12.165326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:12.166113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 36/68] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:12.167461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da29c7-6e08-450b-9d00-e6a9ac4ebe01 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.167754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da29c7-6e08-450b-9d00-e6a9ac4ebe01 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.168043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da29c7-6e08-450b-9d00-e6a9ac4ebe01 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.169453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 37/69] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:12.170456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7882-92d8-4e42-ad13-a7bd4bd038f8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.170701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7882-92d8-4e42-ad13-a7bd4bd038f8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.171021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7882-92d8-4e42-ad13-a7bd4bd038f8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.174408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 38/70] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:12 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:12.174408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf7882-92d8-4e42-ad13-a7bd4bd038f8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.177520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90225313-0fcd-4a28-a12a-c600bbcde335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.178983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225313-0fcd-4a28-a12a-c600bbcde335 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.178983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225313-0fcd-4a28-a12a-c600bbcde335 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.178983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90225313-0fcd-4a28-a12a-c600bbcde335 None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.194885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90225313-0fcd-4a28-a12a-c600bbcde335 None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:12.196379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90225313-0fcd-4a28-a12a-c600bbcde335 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:12.198463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 33/71] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:12.199367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ebce3-bf42-4ef8-a812-a228871e2357 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.199677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ebce3-bf42-4ef8-a812-a228871e2357 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.199931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ebce3-bf42-4ef8-a812-a228871e2357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.217840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c40ebce3-bf42-4ef8-a812-a228871e2357 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:12.219070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c40ebce3-bf42-4ef8-a812-a228871e2357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:12.289460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf7882-92d8-4e42-ad13-a7bd4bd038f8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.289645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 34/72] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:12.291050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857401c0-4692-4879-9dee-850af111209b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.291340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857401c0-4692-4879-9dee-850af111209b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.291629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857401c0-4692-4879-9dee-850af111209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.305101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.311606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-857401c0-4692-4879-9dee-850af111209b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:12.313699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-857401c0-4692-4879-9dee-850af111209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:12.334385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.335015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.335299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.335576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.336304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:12.336613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:12.338013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:12.346291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 39/73] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:12.347444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.384747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 35/74] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:12.385601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857401c0-4692-4879-9dee-850af111209b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.430167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.450457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ff24f-4cd2-43cf-bcf8-cbf3d3afcfc3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.483492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.484125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.484413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.484693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.498953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857401c0-4692-4879-9dee-850af111209b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.519957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.535333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60878b2-f632-472b-ad29-47e8af7e276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.535987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60878b2-f632-472b-ad29-47e8af7e276e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.536274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60878b2-f632-472b-ad29-47e8af7e276e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.536555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60878b2-f632-472b-ad29-47e8af7e276e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.546459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60878b2-f632-472b-ad29-47e8af7e276e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d60878b2-f632-472b-ad29-47e8af7e276e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:12.551417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:12.552315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:12.553106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 36/75] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:12.553736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3a24d-dc72-4f19-85f9-2606396e7411 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.553985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3a24d-dc72-4f19-85f9-2606396e7411 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.554364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3a24d-dc72-4f19-85f9-2606396e7411 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.555510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 37/76] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:12 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:12.556212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3a24d-dc72-4f19-85f9-2606396e7411 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.559525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:12.561040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:12.646665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.656137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3a24d-dc72-4f19-85f9-2606396e7411 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.660483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 40/77] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:12.661331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.691740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f057f-9d5d-4587-a46f-45f58d6328cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.692385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f057f-9d5d-4587-a46f-45f58d6328cb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.692672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f057f-9d5d-4587-a46f-45f58d6328cb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.692950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f057f-9d5d-4587-a46f-45f58d6328cb None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.694768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f057f-9d5d-4587-a46f-45f58d6328cb None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:12.696226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f057f-9d5d-4587-a46f-45f58d6328cb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:12.697831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 38/78] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:12.698972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417262e-e4ef-4c44-8906-ea7bb5cb9777 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.699260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417262e-e4ef-4c44-8906-ea7bb5cb9777 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.699540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417262e-e4ef-4c44-8906-ea7bb5cb9777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.716387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3417262e-e4ef-4c44-8906-ea7bb5cb9777 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:12.717545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3417262e-e4ef-4c44-8906-ea7bb5cb9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:12.732279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.766246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d366b3-8e4f-4eee-8627-8104020501be None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.784536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 39/79] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:12.785383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417262e-e4ef-4c44-8906-ea7bb5cb9777 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.810124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0c260-7bea-4224-b450-913203587234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.810808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c260-7bea-4224-b450-913203587234 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.811100 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c260-7bea-4224-b450-913203587234 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.811379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c260-7bea-4224-b450-913203587234 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.822555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0c260-7bea-4224-b450-913203587234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-01d0c260-7bea-4224-b450-913203587234 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:12.827472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:12.828476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:12.829343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 41/80] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:12.831154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0c260-7bea-4224-b450-913203587234 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.876067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.889624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417262e-e4ef-4c44-8906-ea7bb5cb9777 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.924186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.924917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.925203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.925487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.926199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:12.926543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:12.928475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:12.930911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0c260-7bea-4224-b450-913203587234 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:12.936379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 40/81] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:12.937176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:12.957582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:12.965574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:12.966225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:12.966594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:12.966882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:12.968113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:12.969589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:12.971363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 42/82] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:12.977390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.035711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835f85-5ab2-4476-a9df-484abd281c4f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.069330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.069956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.070242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.070552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.077193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352553-1b80-49d8-9faf-31b43c256086 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.090854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.111555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.112198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.112483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.112758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.113911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.115953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.117548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 43/83] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/domains/default => generated 200 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:13.122304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.141847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.143362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.178789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.215568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226eb91-a4a8-438a-b494-23773ddc815e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.239899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 41/84] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:13.241222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.248923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.249552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.249872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.250154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.250918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:13.251228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.252608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.260626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 44/85] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:13.261410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.295846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.343082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36aba9-af15-4d8c-9024-d07883804bd7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.363171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8a44-6809-4a6a-a947-09c7db062275 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.377012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.377658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.377940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.378216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] PATH_INFO: `/v3/users/754ebcbafca74603b46f7997fa570165` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.379403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] RBAC: Authorizing `identity:get_user(user_id=754ebcbafca74603b46f7997fa570165)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.380959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.382592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 42/86] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/users/754ebcbafca74603b46f7997fa570165 => generated 248 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:13.386049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.392675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.402140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.402834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.403126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.403410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.404204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=04626cce951b4727b3091cbedb6da386) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:13.404527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.405987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.411355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 45/87] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/role_assignments?user.id=04626cce951b4727b3091cbedb6da386&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:13.412718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.494910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030b5b6-e807-4495-9af1-e10ddee167a9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.517636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.529533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9673-c87f-484c-a1a8-6950f0d1f123 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.534224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.535033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.535416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.535791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.536577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.538203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.569277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 43/88] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:49:13 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:13.570219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.575571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.576252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.576538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.576810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.578078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.579596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.581764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 46/89] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:13.582639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.665310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.709786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c0ae-ba37-4036-a5a5-6dc7831769a5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.728091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a022a-7737-483d-9ba9-72e11374b1a8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.764161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.765113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.765439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.765997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.767469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.769559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.772569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 44/90] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:13.774237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:13.776968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.778050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.778519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.779810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.830007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.886099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.888853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.915239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc584142-0834-483b-b85e-1aee649f1a13 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:13.970207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:13.970886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:13.971179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:13.971465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:13.972268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] RBAC: Adding query filter params (role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=04626cce951b4727b3091cbedb6da386) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:13.972607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:13.974331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:13.976475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:13.984939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 45/91] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/role_assignments?user.id=04626cce951b4727b3091cbedb6da386&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:13.985790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:14.043064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 47/92] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:14.060373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:14.103195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9cf1b-40fb-46de-9bb3-b34f8607ae34 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:14.118677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:14.141950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:14.142643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:14.142936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:14.143220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:14.219150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:14.220735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:14.236881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672262-c107-4e6d-99b9-8a0d300fa4eb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:14.311559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:14.312575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:14.313083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:14.313673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:14.318851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:14.320654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:14.322869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 48/93] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:14 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:14.329183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:14.332213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 46/94] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:14.337378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:14.358623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:14.370023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:14.531974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ffda5-3c21-4f0b-b155-a4c94720a151 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:14.577150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbf57c-7027-4d46-810a-4a9601e53ec3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:14.617642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:14.618664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:14.619152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:14.619630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:14.620645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=754ebcbafca74603b46f7997fa570165) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:14.621160 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:14.622853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:14.635869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 49/95] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:14 2022] GET /identity/v3/role_assignments?user.id=754ebcbafca74603b46f7997fa570165&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:14.649099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e5174-39ce-4189-8d50-82fb49e71da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:14.650208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5174-39ce-4189-8d50-82fb49e71da8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:14.650746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5174-39ce-4189-8d50-82fb49e71da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:14.651250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e5174-39ce-4189-8d50-82fb49e71da8 None admin] PATH_INFO: `/v3/projects/15d05d05e4454975bed25ba05c9a42df` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:14.655871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e5174-39ce-4189-8d50-82fb49e71da8 None admin] RBAC: Authorizing `identity:get_project(project_id=15d05d05e4454975bed25ba05c9a42df)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:14.657700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e5174-39ce-4189-8d50-82fb49e71da8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:14.659716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 47/96] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:14 2022] GET /identity/v3/projects/15d05d05e4454975bed25ba05c9a42df => generated 313 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:14.666417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:14.798395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:14.813776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832073c-e2fc-4c41-8c35-8605fa522f03 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:14.857685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b89c32-bbed-40db-8f74-f1e903416146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:14.858246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89c32-bbed-40db-8f74-f1e903416146 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:14.858556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89c32-bbed-40db-8f74-f1e903416146 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:14.858840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b89c32-bbed-40db-8f74-f1e903416146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:14.859638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b89c32-bbed-40db-8f74-f1e903416146 None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=15d05d05e4454975bed25ba05c9a42df, user.id=04626cce951b4727b3091cbedb6da386) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:14.859956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b89c32-bbed-40db-8f74-f1e903416146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:14.861393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b89c32-bbed-40db-8f74-f1e903416146 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:14.868051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 50/97] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:14 2022] GET /identity/v3/role_assignments?user.id=04626cce951b4727b3091cbedb6da386&scope.project.id=15d05d05e4454975bed25ba05c9a42df&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:16.297899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578760e-bd28-4add-a89c-31ff289ddee0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.298468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578760e-bd28-4add-a89c-31ff289ddee0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.298542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578760e-bd28-4add-a89c-31ff289ddee0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.299996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 48/98] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:16.305373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84c96-7596-4c06-9407-a68fc9e4773b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.306173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84c96-7596-4c06-9407-a68fc9e4773b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.306706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84c96-7596-4c06-9407-a68fc9e4773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.329351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fce84c96-7596-4c06-9407-a68fc9e4773b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:16.331031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fce84c96-7596-4c06-9407-a68fc9e4773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:16.416586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 51/99] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:16.456120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578760e-bd28-4add-a89c-31ff289ddee0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:16.557661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:16.570512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789983a-66a8-4deb-96f3-d22c68c71761 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.570808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789983a-66a8-4deb-96f3-d22c68c71761 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.571104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789983a-66a8-4deb-96f3-d22c68c71761 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.572638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 52/100] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:16.579531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157aa96-0a5d-4f2c-ab1c-9b56785e3f9d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.579825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157aa96-0a5d-4f2c-ab1c-9b56785e3f9d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.580114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157aa96-0a5d-4f2c-ab1c-9b56785e3f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.582589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578760e-bd28-4add-a89c-31ff289ddee0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:16.619765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:16.620435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.620729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.621019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.622381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:16.624120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:16.625802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 49/101] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:16.631913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:16.643937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e157aa96-0a5d-4f2c-ab1c-9b56785e3f9d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:16.645742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e157aa96-0a5d-4f2c-ab1c-9b56785e3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:16.745196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f157d-a1e5-450e-9344-9179b9ecdcf6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:16.782025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:16.782775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.783066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.783397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.784089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:16.785530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:16.800630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 53/102] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:16.801955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121511-c362-4453-b420-c5cd0f1e8f54 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.802268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121511-c362-4453-b420-c5cd0f1e8f54 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.803211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121511-c362-4453-b420-c5cd0f1e8f54 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.803339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:16.812387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 54/103] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:16 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:16.814929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 50/104] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:49:16 2022] POST /identity/v3/projects => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:49:16.818311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675b09-ae27-4517-8f3e-62eb30b6870f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:16.818649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675b09-ae27-4517-8f3e-62eb30b6870f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:16.818995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675b09-ae27-4517-8f3e-62eb30b6870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:16.851351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9b675b09-ae27-4517-8f3e-62eb30b6870f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:16.852704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9b675b09-ae27-4517-8f3e-62eb30b6870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:16.855994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:16.874927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:17.010354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 55/105] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:17.011715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfc1b7-3a2c-4d71-8bd2-acec83e4884d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.012007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfc1b7-3a2c-4d71-8bd2-acec83e4884d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.012288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfc1b7-3a2c-4d71-8bd2-acec83e4884d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.013868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 56/106] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:17.043065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937937c1-2f0a-4c96-b976-b735818a18be None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.043364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937937c1-2f0a-4c96-b976-b735818a18be None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.043629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937937c1-2f0a-4c96-b976-b735818a18be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.075116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-937937c1-2f0a-4c96-b976-b735818a18be None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:17.077526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-937937c1-2f0a-4c96-b976-b735818a18be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:17.118126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28162110-1d4b-41dc-8006-100ae0e361a1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:17.165582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 57/107] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:17.167884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:17.168766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.169248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.169738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.170589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937937c1-2f0a-4c96-b976-b735818a18be None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:17.182677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:17.188868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:17.189704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:17.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:17.193977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 51/108] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:17.202854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:17.266978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:17.301787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:17.345469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae44481-ecc4-40d9-8317-d63e3181df3a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:17.346722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937937c1-2f0a-4c96-b976-b735818a18be None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:17.391790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:17.392891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.393379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.393850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.406770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:17.413271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:17.414125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:17.414934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:17.417404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 58/109] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:17.418707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:17.450987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:17.451650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.451938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.452209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.491622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:17.497274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:17.498142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:17.498925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:17.507597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 52/110] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:17.507844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:17.549684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e58c2-cfd1-4d61-afbd-d707674b5465 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:17.655083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:17.655652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.655946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.656236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.656973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:17.657285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:17.658958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:17.660472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:17.666913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc40c85-42ca-40ce-be0a-4fd0092211e8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:17.676207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 59/111] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:17 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:17.682709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:17.691310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:17.711534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a29fc-403e-4baf-b3b4-f6ae5a4cd13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:17.712168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a29fc-403e-4baf-b3b4-f6ae5a4cd13c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.712451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a29fc-403e-4baf-b3b4-f6ae5a4cd13c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.712729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a29fc-403e-4baf-b3b4-f6ae5a4cd13c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.713538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a29fc-403e-4baf-b3b4-f6ae5a4cd13c None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:17.713903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a29fc-403e-4baf-b3b4-f6ae5a4cd13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:17.715750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a29fc-403e-4baf-b3b4-f6ae5a4cd13c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:17.725145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 53/112] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:17.730946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba208-df30-4941-9539-48155de9bb2b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.731273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba208-df30-4941-9539-48155de9bb2b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.731629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba208-df30-4941-9539-48155de9bb2b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.733333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 54/113] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:17 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:17.734076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba208-df30-4941-9539-48155de9bb2b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:17.821856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbecf83-9119-4209-b539-8e58ea2674b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:17.859174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:17.859818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.860087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.860368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.861096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:17.861403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:17.861999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba208-df30-4941-9539-48155de9bb2b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:17.862829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:17.872498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 60/114] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:17 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:17.873278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:17.908274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09265741-66f8-47d5-ae5f-3b4eb0dd3338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:17.909000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09265741-66f8-47d5-ae5f-3b4eb0dd3338 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.909329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09265741-66f8-47d5-ae5f-3b4eb0dd3338 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.909587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09265741-66f8-47d5-ae5f-3b4eb0dd3338 None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.910774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09265741-66f8-47d5-ae5f-3b4eb0dd3338 None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:17.912870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09265741-66f8-47d5-ae5f-3b4eb0dd3338 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:17.919145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 55/115] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:17 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:17.919145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd3eb-7a95-4729-b7c4-07f083375d7f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:17.919145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd3eb-7a95-4729-b7c4-07f083375d7f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:17.919145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd3eb-7a95-4729-b7c4-07f083375d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:17.935106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-af7bd3eb-7a95-4729-b7c4-07f083375d7f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:17.936381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-af7bd3eb-7a95-4729-b7c4-07f083375d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:17.946884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:17.979498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:18.001963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a888e9d-83f3-490b-b749-c1e6f01e3dd5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.004060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 56/116] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:18.004816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd3eb-7a95-4729-b7c4-07f083375d7f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.040151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a02c5-272f-44f7-8aa6-ae11de3eebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.040798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a02c5-272f-44f7-8aa6-ae11de3eebeb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.041084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a02c5-272f-44f7-8aa6-ae11de3eebeb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.041502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a02c5-272f-44f7-8aa6-ae11de3eebeb None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.042753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a02c5-272f-44f7-8aa6-ae11de3eebeb None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.044154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a02c5-272f-44f7-8aa6-ae11de3eebeb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.050019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 61/117] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:17 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:18.050019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843722e9-f17a-4e83-a142-ab9122cbd3d0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.050019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843722e9-f17a-4e83-a142-ab9122cbd3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.050019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843722e9-f17a-4e83-a142-ab9122cbd3d0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.050019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 62/118] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:18 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:18.050019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843722e9-f17a-4e83-a142-ab9122cbd3d0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.127228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd3eb-7a95-4729-b7c4-07f083375d7f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.162188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843722e9-f17a-4e83-a142-ab9122cbd3d0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.163378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.164033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.164323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.164604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] PATH_INFO: `/v3/users/a8864ffd00b543f1ab93db119ef23347` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.178218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] RBAC: Authorizing `identity:get_user(user_id=a8864ffd00b543f1ab93db119ef23347)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.179856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.186133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 57/119] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/users/a8864ffd00b543f1ab93db119ef23347 => generated 290 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:18.186133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.197732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:18.207640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.208210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.208495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.208875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.210228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.211844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.218292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 63/120] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:18.218292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.222673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:18.294243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebeed-3bac-4f83-99d5-f706f0bcb546 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.329233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ab962-30b4-45a6-94d1-c348b9a9b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.329911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ab962-30b4-45a6-94d1-c348b9a9b211 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.330200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ab962-30b4-45a6-94d1-c348b9a9b211 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.330510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ab962-30b4-45a6-94d1-c348b9a9b211 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.330742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4225d68-1167-4741-a857-95d1ca7b0278 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.342851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ab962-30b4-45a6-94d1-c348b9a9b211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ae9ab962-30b4-45a6-94d1-c348b9a9b211 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:18.347961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:18.349540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 58/121] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:18.350442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9c54-2620-49f8-8211-d814487ff67a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.351287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9c54-2620-49f8-8211-d814487ff67a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.351287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9c54-2620-49f8-8211-d814487ff67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.369037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-624e9c54-2620-49f8-8211-d814487ff67a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:18.370287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-624e9c54-2620-49f8-8211-d814487ff67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:18.377542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.378204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.378544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.378827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.380000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.381973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.388484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 64/122] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:18.388484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.444046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 59/123] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:18.444885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9c54-2620-49f8-8211-d814487ff67a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.464255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:18.478602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:18.513417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0d576-56ea-4457-adb5-e36a4c3f9331 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.548147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.548776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.549069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.549353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.564245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9c54-2620-49f8-8211-d814487ff67a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.608464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.609538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.609843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.610380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/04626cce951b4727b3091cbedb6da386/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.613465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=335cb7bfb0d4444487deea2e3fd3b433, user_id=04626cce951b4727b3091cbedb6da386, role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.615669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.619476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.621010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.635972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 60/124] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:18 2022] PUT /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/04626cce951b4727b3091cbedb6da386/roles/0db42c55aa904f95983cff92ac10ac3b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:18.639154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.706338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:18.749067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:18.752711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 65/125] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:18.753713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.770117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738496-dc8e-4fbc-8e05-ea53471c82d8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.810446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.811450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.811938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.812419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.813306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:18.813769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.815668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.827158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 61/126] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:18.828319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.881606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c6ff8-202e-4d3d-abe2-733f0cd74a2d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:18.922497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:18.923183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:18.923467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:18.923754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/04626cce951b4727b3091cbedb6da386/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:18.925716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] RBAC: Authorizing `identity:create_grant(project_id=335cb7bfb0d4444487deea2e3fd3b433, user_id=04626cce951b4727b3091cbedb6da386, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:18.927210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:18.944500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 66/127] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:18 2022] PUT /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/04626cce951b4727b3091cbedb6da386/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:18.945167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:18.973957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac697-3d79-45b7-90e8-7840e26b4b7c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.001028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:19.068193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.069211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.069656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.070085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.102975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:19.106387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052a8df-fec7-4a87-b69d-9c041643094d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:19.108516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:19.109359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:19.110115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 62/128] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:19.118647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.134581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:19.150133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.150919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.151209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.151492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.152795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.154432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.156315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 67/129] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:18 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:19.162789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.232972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c759cf-af40-49e4-bdba-51920c07a323 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.264704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:19.268425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.269285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.269578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.269859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.271697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.273685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.275618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 63/130] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:19 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:19.275870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7456b-da88-4488-bae6-4e342b859dbb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.276397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.319060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.319875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.320232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.320517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.321310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:19.321621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.323269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.343354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 68/131] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:19.343997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.367109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:19.402367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28bf73-f0a7-4956-8922-1726594df4f2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.450568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.451669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.451956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.452506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.453307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] RBAC: Adding query filter params (role.id=c7886317cc6442cf921bd42a66462c1b, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=a8864ffd00b543f1ab93db119ef23347) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:19.453901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.455770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.463784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 64/132] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:19 2022] GET /identity/v3/role_assignments?user.id=a8864ffd00b543f1ab93db119ef23347&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=c7886317cc6442cf921bd42a66462c1b => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:19.464651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.483652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2317c46-0523-4829-8f1a-e9d7c2d653a0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.582027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c98afc-ef5f-46a5-8910-d0a41152053c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.597864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417e492-0aa7-4b32-b32c-1443ff64f50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.598570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e492-0aa7-4b32-b32c-1443ff64f50a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.598856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e492-0aa7-4b32-b32c-1443ff64f50a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.599136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e492-0aa7-4b32-b32c-1443ff64f50a None admin] PATH_INFO: `/v3/projects/15d05d05e4454975bed25ba05c9a42df` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.602872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e492-0aa7-4b32-b32c-1443ff64f50a None admin] RBAC: Authorizing `identity:get_project(project_id=15d05d05e4454975bed25ba05c9a42df)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.604650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417e492-0aa7-4b32-b32c-1443ff64f50a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.606498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 69/133] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:19 2022] GET /identity/v3/projects/15d05d05e4454975bed25ba05c9a42df => generated 313 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:19.607830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da0f6-1444-48f3-aac5-173c323d86a2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.608147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da0f6-1444-48f3-aac5-173c323d86a2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.608502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da0f6-1444-48f3-aac5-173c323d86a2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.609787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 70/134] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:19.616740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46da0f6-1444-48f3-aac5-173c323d86a2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.624746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70187a65-477e-4c82-95f8-6fc00b3f4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.625439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187a65-477e-4c82-95f8-6fc00b3f4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.625726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187a65-477e-4c82-95f8-6fc00b3f4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.626007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70187a65-477e-4c82-95f8-6fc00b3f4a2d None admin] PATH_INFO: `/v3/users/754ebcbafca74603b46f7997fa570165` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.628294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187a65-477e-4c82-95f8-6fc00b3f4a2d None admin] RBAC: Authorizing `identity:get_user(user_id=754ebcbafca74603b46f7997fa570165)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.629795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70187a65-477e-4c82-95f8-6fc00b3f4a2d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.637080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 65/135] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:19 2022] GET /identity/v3/users/754ebcbafca74603b46f7997fa570165 => generated 248 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:19.638822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d9f9-e23c-45b8-a904-cad01167adfd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.639113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d9f9-e23c-45b8-a904-cad01167adfd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.639394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436d9f9-e23c-45b8-a904-cad01167adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.660872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:19.668425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:19.679591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4436d9f9-e23c-45b8-a904-cad01167adfd None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:19.680817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4436d9f9-e23c-45b8-a904-cad01167adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:19.767815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 66/136] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:19.768618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d9f9-e23c-45b8-a904-cad01167adfd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.846896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46da0f6-1444-48f3-aac5-173c323d86a2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.910978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436d9f9-e23c-45b8-a904-cad01167adfd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:19.934774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.935470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.935751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.936029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] PATH_INFO: `/v3/projects/15d05d05e4454975bed25ba05c9a42df/users/04626cce951b4727b3091cbedb6da386/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.940878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=15d05d05e4454975bed25ba05c9a42df, user_id=04626cce951b4727b3091cbedb6da386, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.942551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.952554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:19.953275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:19.953564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:19.953844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:19.955128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:19.956626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:19.958422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 67/137] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:19 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:19.959383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:19.963067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:19.975698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 71/138] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:19 2022] PUT /identity/v3/projects/15d05d05e4454975bed25ba05c9a42df/users/04626cce951b4727b3091cbedb6da386/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:19.976721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:20.075960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6940-0dea-4980-87d0-095d0763c931 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:20.112371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:20.115891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:20.116580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:20.116867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:20.117150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:20.118451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:20.121824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:20.121824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 68/139] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:19 2022] GET /identity/v3/domains/default => generated 200 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:20.128372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:20.180261 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf373664-bec0-43c7-a07f-b802c5d570a0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:20.206621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:20.239747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b5e15-ffcf-4f5f-8491-df0a3b0b9c55 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:20.272266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1088b11-2322-4d4a-9c29-87da550502a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:20.273030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088b11-2322-4d4a-9c29-87da550502a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:20.273322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088b11-2322-4d4a-9c29-87da550502a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:20.273604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088b11-2322-4d4a-9c29-87da550502a1 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/754ebcbafca74603b46f7997fa570165/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:20.277291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11daf-0a07-4602-8d70-335fbcbedad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:20.277614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1088b11-2322-4d4a-9c29-87da550502a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=335cb7bfb0d4444487deea2e3fd3b433, user_id=754ebcbafca74603b46f7997fa570165, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:20.277925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11daf-0a07-4602-8d70-335fbcbedad0 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:20.278214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11daf-0a07-4602-8d70-335fbcbedad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:20.278517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11daf-0a07-4602-8d70-335fbcbedad0 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:20.279092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1088b11-2322-4d4a-9c29-87da550502a1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:20.279196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11daf-0a07-4602-8d70-335fbcbedad0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:20.280652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11daf-0a07-4602-8d70-335fbcbedad0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:20.305128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 72/140] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:19 2022] PUT /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/754ebcbafca74603b46f7997fa570165/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:20.305329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 69/141] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:49:20 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:49:20.983003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39def-f423-4d20-ab98-91e2d7fa2047 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:20.983954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39def-f423-4d20-ab98-91e2d7fa2047 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:20.984457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39def-f423-4d20-ab98-91e2d7fa2047 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:20.986054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 73/142] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:20.992356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac56e6-80aa-4f7a-86cb-ff76974ac2c1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:20.992824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac56e6-80aa-4f7a-86cb-ff76974ac2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:20.993026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac56e6-80aa-4f7a-86cb-ff76974ac2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:21.016728 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e0ac56e6-80aa-4f7a-86cb-ff76974ac2c1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:21.017938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e0ac56e6-80aa-4f7a-86cb-ff76974ac2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:21.102986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 70/143] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:21.142601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39def-f423-4d20-ab98-91e2d7fa2047 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:21.270111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39def-f423-4d20-ab98-91e2d7fa2047 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:21.311500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:21.312158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:21.312439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:21.312712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:21.326911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:21.332369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:21.338514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:21.339369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:21.340121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:21.341535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 74/144] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:21.348224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac56e6-80aa-4f7a-86cb-ff76974ac2c1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:21.429612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:21.485680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac56e6-80aa-4f7a-86cb-ff76974ac2c1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:21.529745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:21.530413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:21.530705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:21.530986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:21.531721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:21.532044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:21.533434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:21.542118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 71/145] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:21.548099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:21.672825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815d39-9cad-45b5-9459-4a8dbb6a286e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:21.715554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84086fa-5ca8-40b9-8814-e6189086c2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:21.716191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84086fa-5ca8-40b9-8814-e6189086c2ad None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:21.716473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84086fa-5ca8-40b9-8814-e6189086c2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:21.716746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84086fa-5ca8-40b9-8814-e6189086c2ad None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:21.718951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84086fa-5ca8-40b9-8814-e6189086c2ad None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:21.720428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84086fa-5ca8-40b9-8814-e6189086c2ad None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:21.722358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 75/146] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:21 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:21.728061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:21.849055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbdb5a-5151-4c67-b84c-e2ebf378c62b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:21.875718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:21.890024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:21.890707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:21.890992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:21.891274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:21.977225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:21.978649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:22.096668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9afbd-dda8-473e-a864-fc0201e4699d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.097382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9afbd-dda8-473e-a864-fc0201e4699d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.097382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9afbd-dda8-473e-a864-fc0201e4699d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.097683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 72/147] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:22.098624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 76/148] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:22.104324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:22.111701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9b64-59a0-46c6-bafa-9123932e4a1d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.112231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9b64-59a0-46c6-bafa-9123932e4a1d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.112855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9b64-59a0-46c6-bafa-9123932e4a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.139289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.163398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-48ed9b64-59a0-46c6-bafa-9123932e4a1d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:22.164927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-48ed9b64-59a0-46c6-bafa-9123932e4a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:22.260295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5a8e-4aa8-4822-a676-a77089d819f8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:22.319833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.326901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:22.327565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.327846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.328115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.330772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 77/149] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:22.331194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:22.332706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:22.335240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 73/150] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:22 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:22.343508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed9b64-59a0-46c6-bafa-9123932e4a1d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:22.374537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:22.494923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed9b64-59a0-46c6-bafa-9123932e4a1d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:22.548507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b66ba7-b26f-4473-a7af-d813a4de4089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:22.549390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66ba7-b26f-4473-a7af-d813a4de4089 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.549834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66ba7-b26f-4473-a7af-d813a4de4089 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.550294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b66ba7-b26f-4473-a7af-d813a4de4089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.551256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66ba7-b26f-4473-a7af-d813a4de4089 None admin] RBAC: Adding query filter params (role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=04626cce951b4727b3091cbedb6da386) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:22.551733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66ba7-b26f-4473-a7af-d813a4de4089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:22.553389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b66ba7-b26f-4473-a7af-d813a4de4089 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:22.565548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 78/151] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:22 2022] GET /identity/v3/role_assignments?user.id=04626cce951b4727b3091cbedb6da386&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 610 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:22.604509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.609510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf71be-7cb9-4fc5-b6cb-6345f98d1280 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.611090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf71be-7cb9-4fc5-b6cb-6345f98d1280 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.611090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf71be-7cb9-4fc5-b6cb-6345f98d1280 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.612999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 79/152] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:22.619218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a6b93-2637-4ed3-8481-268c18d8ad76 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.619756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a6b93-2637-4ed3-8481-268c18d8ad76 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.620233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a6b93-2637-4ed3-8481-268c18d8ad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.623628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5bef-d668-4cd2-bb27-c1c12c1cb56b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:22.655399 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f35a6b93-2637-4ed3-8481-268c18d8ad76 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:22.656952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f35a6b93-2637-4ed3-8481-268c18d8ad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:22.711017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5395-474b-4745-aa89-24959f828674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:22.711969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5395-474b-4745-aa89-24959f828674 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:22.712415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5395-474b-4745-aa89-24959f828674 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:22.712848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e5395-474b-4745-aa89-24959f828674 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:22.741905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:22.742252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e5395-474b-4745-aa89-24959f828674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-252e5395-474b-4745-aa89-24959f828674 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:22.747779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:22.748887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:22.749956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:22.757758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 74/153] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:22.758981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5395-474b-4745-aa89-24959f828674 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:22.766414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 80/154] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:22.815445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a6b93-2637-4ed3-8481-268c18d8ad76 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:22.948689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e5395-474b-4745-aa89-24959f828674 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.000250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a6b93-2637-4ed3-8481-268c18d8ad76 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.009649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.010513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.010963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.011400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.012271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:23.012721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.014539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.027577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 75/155] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:23.034569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.053883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.103157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.103751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.104043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.104314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.142913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:23.148522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:23.149560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:23.150819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 81/156] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:23.158375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.176926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fefa9-601b-4ec4-8fe0-7d0fc125b0e2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.220907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.221839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.222298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.222742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.224097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.225748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.231984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 76/157] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:23.239121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.272125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.341049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62567-c1a8-497a-b396-1f2117161542 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.353439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.389435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee71c1-5060-4cd7-bcae-6f9c6e57a082 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.418307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.418307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.418307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.418307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.418759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:23.418759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.419233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.434700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 82/158] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:23.435861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.449940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.450878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.451321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.451750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.567811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.569625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.674555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4beb00-fa91-46f7-81e8-317f7c888adc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:23.708068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.723762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:23.759432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 77/159] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:23.776627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.806030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:23.806030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:23.806030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:23.806030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] PATH_INFO: `/v3/users/a8864ffd00b543f1ab93db119ef23347` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:23.811371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] RBAC: Authorizing `identity:get_user(user_id=a8864ffd00b543f1ab93db119ef23347)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:23.812599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:23.814332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 83/160] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/users/a8864ffd00b543f1ab93db119ef23347 => generated 290 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:23.823524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:23.981465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62cad4-774c-4427-bf03-e34f785fa99c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:24.026787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab7f6-2288-403e-80e9-fa1d21d49ddb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:24.079104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8e02c-1539-4f5a-a6d5-5edfce9b1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:24.080705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e02c-1539-4f5a-a6d5-5edfce9b1316 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.081882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e02c-1539-4f5a-a6d5-5edfce9b1316 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.082796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e02c-1539-4f5a-a6d5-5edfce9b1316 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.086025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dce1ef-7866-4494-a406-e41388d152fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:24.087080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8e02c-1539-4f5a-a6d5-5edfce9b1316 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:24.087976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dce1ef-7866-4494-a406-e41388d152fa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.090570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8e02c-1539-4f5a-a6d5-5edfce9b1316 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:24.091277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dce1ef-7866-4494-a406-e41388d152fa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.091923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dce1ef-7866-4494-a406-e41388d152fa None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.097949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 84/161] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:24.098159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dce1ef-7866-4494-a406-e41388d152fa None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:24.104385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbe4ae-da67-4256-808c-88ab628b242d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.105220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dce1ef-7866-4494-a406-e41388d152fa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:24.108281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbe4ae-da67-4256-808c-88ab628b242d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.109760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 78/162] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:23 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:24.115130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbe4ae-da67-4256-808c-88ab628b242d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.125481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 85/163] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:24 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:24.126346 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e02fe-c9bd-42f8-8140-e948b3828d64 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.127281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbe4ae-da67-4256-808c-88ab628b242d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:24.127734 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e02fe-c9bd-42f8-8140-e948b3828d64 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.128190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e02fe-c9bd-42f8-8140-e948b3828d64 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.134456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 79/164] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:24 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:24.136438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e02fe-c9bd-42f8-8140-e948b3828d64 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:24.250764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.266605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.294360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbe4ae-da67-4256-808c-88ab628b242d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:24.332188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345ce8-1f45-476a-a2eb-ea3d79c2812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:24.333249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345ce8-1f45-476a-a2eb-ea3d79c2812b None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.334380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345ce8-1f45-476a-a2eb-ea3d79c2812b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.334870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345ce8-1f45-476a-a2eb-ea3d79c2812b None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/a8864ffd00b543f1ab93db119ef23347/roles/c7886317cc6442cf921bd42a66462c1b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.337544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345ce8-1f45-476a-a2eb-ea3d79c2812b None admin] RBAC: Authorizing `identity:create_grant(project_id=335cb7bfb0d4444487deea2e3fd3b433, user_id=a8864ffd00b543f1ab93db119ef23347, role_id=c7886317cc6442cf921bd42a66462c1b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:24.339309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345ce8-1f45-476a-a2eb-ea3d79c2812b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:24.356808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 86/165] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:24 2022] PUT /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/users/a8864ffd00b543f1ab93db119ef23347/roles/c7886317cc6442cf921bd42a66462c1b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:24.358742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fa65-7979-4788-a31c-d65750bec4b7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.359281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fa65-7979-4788-a31c-d65750bec4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.360721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fa65-7979-4788-a31c-d65750bec4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.382888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9a03fa65-7979-4788-a31c-d65750bec4b7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:24.384742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9a03fa65-7979-4788-a31c-d65750bec4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:24.467647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 87/166] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:24.469535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05319783-fa1b-45f0-9c6a-4c16d6de69b6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.470029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05319783-fa1b-45f0-9c6a-4c16d6de69b6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.470553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05319783-fa1b-45f0-9c6a-4c16d6de69b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.470766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e02fe-c9bd-42f8-8140-e948b3828d64 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:24.504531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-05319783-fa1b-45f0-9c6a-4c16d6de69b6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:24.506934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-05319783-fa1b-45f0-9c6a-4c16d6de69b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:24.566638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.619639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:24.620446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.620624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.620897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.624148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=04626cce951b4727b3091cbedb6da386) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:24.624148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:24.624148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:24.624408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 88/167] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:24.625095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05319783-fa1b-45f0-9c6a-4c16d6de69b6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:24.644637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 80/168] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:24 2022] GET /identity/v3/role_assignments?user.id=04626cce951b4727b3091cbedb6da386&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 610 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:24.673247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:24.784858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05319783-fa1b-45f0-9c6a-4c16d6de69b6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:24.825174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428bace-16a7-4036-8494-1da359c2fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:24.825888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428bace-16a7-4036-8494-1da359c2fffa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.826233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428bace-16a7-4036-8494-1da359c2fffa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.826569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428bace-16a7-4036-8494-1da359c2fffa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.839589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428bace-16a7-4036-8494-1da359c2fffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1428bace-16a7-4036-8494-1da359c2fffa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:24.844970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:24.846001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:24.846821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:24.849598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 89/169] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:24.851242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50bb69-c26b-4d9f-9a7e-7c5c3dc5ac05 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.851739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50bb69-c26b-4d9f-9a7e-7c5c3dc5ac05 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.852228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50bb69-c26b-4d9f-9a7e-7c5c3dc5ac05 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.858166 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 90/170] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:24.859380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50bb69-c26b-4d9f-9a7e-7c5c3dc5ac05 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:24.861595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2cc23-bddc-4920-b3f5-5c61da9b4a54 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:24.877305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.902910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:24.917131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069a4f3-3073-4ab4-b0bb-af15c261ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:24.918181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a4f3-3073-4ab4-b0bb-af15c261ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.919177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a4f3-3073-4ab4-b0bb-af15c261ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.919660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a4f3-3073-4ab4-b0bb-af15c261ebe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.936313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069a4f3-3073-4ab4-b0bb-af15c261ebe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8069a4f3-3073-4ab4-b0bb-af15c261ebe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:24.945096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:24.945971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:24.946784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:24.948535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 81/171] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:24.953933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b4bc5-08a3-46ae-ae7b-41f40b253a95 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:24.953933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b4bc5-08a3-46ae-ae7b-41f40b253a95 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:24.953933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b4bc5-08a3-46ae-ae7b-41f40b253a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:24.994150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-642b4bc5-08a3-46ae-ae7b-41f40b253a95 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:24.995476 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-642b4bc5-08a3-46ae-ae7b-41f40b253a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:25.022752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50bb69-c26b-4d9f-9a7e-7c5c3dc5ac05 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.091061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.091952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.092394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.092821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.093704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:25.094162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.095717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.103529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 82/172] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:25.104729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b4bc5-08a3-46ae-ae7b-41f40b253a95 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.110033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 91/173] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:24 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:25.116605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.239578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.244601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b4bc5-08a3-46ae-ae7b-41f40b253a95 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.290288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.290288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.290288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.290288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.291102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:25.291102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.291592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.299622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.303685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 83/174] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:25.305291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.315492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787223-717b-443a-8073-a854fafc3f1e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.378375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.379326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.379820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.380291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] PATH_INFO: `/v3/users/04626cce951b4727b3091cbedb6da386` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.382287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] RBAC: Authorizing `identity:get_user(user_id=04626cce951b4727b3091cbedb6da386)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.384133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.387841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 92/175] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/users/04626cce951b4727b3091cbedb6da386 => generated 276 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:25.389186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.466095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6c8e-713f-4fc9-af58-6f465972c6a2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.516647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f0f4a-aca6-48e4-84bd-5533968b01fd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.540653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41363a-2716-429c-9f8c-b2815744ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.541716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41363a-2716-429c-9f8c-b2815744ca02 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.542409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41363a-2716-429c-9f8c-b2815744ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.542889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41363a-2716-429c-9f8c-b2815744ca02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.555130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41363a-2716-429c-9f8c-b2815744ca02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bc41363a-2716-429c-9f8c-b2815744ca02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:25.561198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:25.562065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:25.562879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:25.563640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.564244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.564535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.564826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] PATH_INFO: `/v3/users/754ebcbafca74603b46f7997fa570165` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.570250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] RBAC: Authorizing `identity:get_user(user_id=754ebcbafca74603b46f7997fa570165)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.570250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.570250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 93/177] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/users/754ebcbafca74603b46f7997fa570165 => generated 248 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:25.570705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 84/177] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:25.570805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.572904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7b8e6-8e78-4abc-be41-30d1d6d1d81b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.573596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7b8e6-8e78-4abc-be41-30d1d6d1d81b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.573962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7b8e6-8e78-4abc-be41-30d1d6d1d81b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.575793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 85/178] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:25.580783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161df7c2-52b1-46ca-a438-ee13ccd4024e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.580783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161df7c2-52b1-46ca-a438-ee13ccd4024e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.580783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161df7c2-52b1-46ca-a438-ee13ccd4024e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.580783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 86/179] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:25.580783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161df7c2-52b1-46ca-a438-ee13ccd4024e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.602884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.609147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.676968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edb8ee-e9d8-4a88-b31b-d3f070e140a3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.698826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161df7c2-52b1-46ca-a438-ee13ccd4024e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.711199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a10dc0-54a0-4ed5-8952-2e0e58fcc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.711833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a10dc0-54a0-4ed5-8952-2e0e58fcc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.712117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a10dc0-54a0-4ed5-8952-2e0e58fcc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.712396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a10dc0-54a0-4ed5-8952-2e0e58fcc2e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.734832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.735459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.735740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.736014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.736840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:25.737260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.738667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.747971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 87/180] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:25.748563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:25.787297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a10dc0-54a0-4ed5-8952-2e0e58fcc2e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.788761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a10dc0-54a0-4ed5-8952-2e0e58fcc2e6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:25.816675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.836642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.852847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b425c9-09c5-4272-85d3-f0ab566e4e4b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:25.889559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:25.890320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.890604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.890877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.913227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 94/181] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:25.918984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257072-01b4-49de-882e-45c9322dd1aa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:25.919276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257072-01b4-49de-882e-45c9322dd1aa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:25.919560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5257072-01b4-49de-882e-45c9322dd1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:25.937925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c5257072-01b4-49de-882e-45c9322dd1aa None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:25.939309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c5257072-01b4-49de-882e-45c9322dd1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:25.963063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:25.964535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.010292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 95/182] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:26.011617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402c2e-dc1d-4650-a4ba-7913a75f170a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.011991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402c2e-dc1d-4650-a4ba-7913a75f170a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.012267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402c2e-dc1d-4650-a4ba-7913a75f170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.040361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e6402c2e-dc1d-4650-a4ba-7913a75f170a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:26.041556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e6402c2e-dc1d-4650-a4ba-7913a75f170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:26.053983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.073338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 88/183] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:26.074242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.114620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.129074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 96/184] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:26.130273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402c2e-dc1d-4650-a4ba-7913a75f170a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.193671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6789-1ac7-4b62-b5c8-fed1a5e73dfe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.238074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.238979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.239518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.239833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] PATH_INFO: `/v3/users/4a46e3069ead4bd78735151a29d55ec5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.251969 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402c2e-dc1d-4650-a4ba-7913a75f170a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.254675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=4a46e3069ead4bd78735151a29d55ec5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.256188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.258043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 89/185] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/users/4a46e3069ead4bd78735151a29d55ec5 => generated 284 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:26.263267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.288843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.289497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.289785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.290063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] PATH_INFO: `/v3/projects/15d05d05e4454975bed25ba05c9a42df` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.291265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] RBAC: Authorizing `identity:get_project(project_id=15d05d05e4454975bed25ba05c9a42df)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.292710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.299236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 97/186] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/projects/15d05d05e4454975bed25ba05c9a42df => generated 313 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:26.300140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.308294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.367072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.368087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0279c0-74a8-42bc-aa7e-a1c3ff684cd5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.404928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.405902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.406209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.406504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.414874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c082e-ac66-4f12-b6cb-fccf8001abe3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.417656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:26.422678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:26.423545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:26.424320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 90/187] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:26.424976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.457607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.458188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.458848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.459151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.460455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.461920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.463634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 98/188] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:26.464406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.539553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f25cd-1971-4ab4-bf6b-109490b8abce None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.541169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.575148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d48e8-b422-4f88-a870-9f4462b8a513 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.578766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.579416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.579695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.579963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.581095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.582564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.584474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 91/189] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/domains/default => generated 200 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:26.585018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.606214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.619800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.620451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.620737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.621029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.690679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e7c6-4a72-4e0e-b0dc-281bdfa41fa6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.696989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.698863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.728305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.728932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.729214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.729559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.730383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=15d05d05e4454975bed25ba05c9a42df, user.id=04626cce951b4727b3091cbedb6da386) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:26.730698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.732127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.738602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 92/190] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/role_assignments?user.id=04626cce951b4727b3091cbedb6da386&scope.project.id=15d05d05e4454975bed25ba05c9a42df&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 610 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:26.739214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.778620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.839058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 99/191] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:26.840058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.868447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9a50-3083-48e5-aa32-a83e8b07b198 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:26.874186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.919875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:26.920587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:26.920881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:26.921160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:26.922324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:26.922637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:26.924150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:26.935852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 93/192] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:26.941028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:26.976067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7767e2-e81c-42da-8e1a-868843c2f5e3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.020355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.020940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.021223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.021501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.022377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=754ebcbafca74603b46f7997fa570165) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:27.022718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:27.024173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:27.030037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 100/193] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:26 2022] GET /identity/v3/role_assignments?user.id=754ebcbafca74603b46f7997fa570165&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:27.030854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:27.062902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:27.070979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9faa7a-a165-4a91-95d0-0d02a42d45b4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.108533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.109180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.109469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.109747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.110483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:27.111958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:27.142298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 94/194] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:49:26 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:27.142298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:27.152893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:27.169914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3df05-5729-4a15-af16-3fbaca7dc2f0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.214907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc3317-5e37-411e-9612-23c48280e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.215608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3317-5e37-411e-9612-23c48280e0cb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.215889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3317-5e37-411e-9612-23c48280e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.216162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3317-5e37-411e-9612-23c48280e0cb None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.218087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc3317-5e37-411e-9612-23c48280e0cb None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:27.219636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc3317-5e37-411e-9612-23c48280e0cb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:27.226594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 101/195] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:27 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:27.226594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b521-83c7-4bce-b0dc-fbf1ed69ae20 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.226594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b521-83c7-4bce-b0dc-fbf1ed69ae20 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.226594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5b521-83c7-4bce-b0dc-fbf1ed69ae20 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.226594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 102/196] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:27.230391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5b521-83c7-4bce-b0dc-fbf1ed69ae20 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:27.282849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a67a81-af0c-4d93-9f52-56af9d59a5bb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.332061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07245f3f-85ac-41b4-b4cd-63bec1a32284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.332721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07245f3f-85ac-41b4-b4cd-63bec1a32284 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.333007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07245f3f-85ac-41b4-b4cd-63bec1a32284 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.333291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07245f3f-85ac-41b4-b4cd-63bec1a32284 None admin] PATH_INFO: `/v3/users/4a46e3069ead4bd78735151a29d55ec5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.334536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07245f3f-85ac-41b4-b4cd-63bec1a32284 None admin] RBAC: Authorizing `identity:get_user(user_id=4a46e3069ead4bd78735151a29d55ec5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:27.336030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07245f3f-85ac-41b4-b4cd-63bec1a32284 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:27.337787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 95/197] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:27 2022] GET /identity/v3/users/4a46e3069ead4bd78735151a29d55ec5 => generated 284 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:27.338759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3ab32-5969-4f60-a340-682654185d8a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.339058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3ab32-5969-4f60-a340-682654185d8a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.339326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3ab32-5969-4f60-a340-682654185d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.358627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-55e3ab32-5969-4f60-a340-682654185d8a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:27.359841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-55e3ab32-5969-4f60-a340-682654185d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:27.365922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5b521-83c7-4bce-b0dc-fbf1ed69ae20 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.375244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:27.420262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.420895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.421173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.421442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.422243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=4a46e3069ead4bd78735151a29d55ec5) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:27.422575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:27.424022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:27.431194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 103/198] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:27 2022] GET /identity/v3/role_assignments?user.id=4a46e3069ead4bd78735151a29d55ec5&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:27.432124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:27.446763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 96/199] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:27.460768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:27.477485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3ab32-5969-4f60-a340-682654185d8a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:27.584468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef675ea-9c1e-41f7-9f27-9819e52bbe07 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.612831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3ab32-5969-4f60-a340-682654185d8a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.627235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.627883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.628171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.628452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.662591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.664252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.665017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.665529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.693429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:27.701030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:27.701915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:27.702709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:27.704170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 97/200] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:27.710178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:27.724859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:27.757404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:27.759393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:27.793958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:27.928991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 104/201] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:27.935746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869eeaa-2dfe-4101-b3f4-9130b4e8dbdd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:27.938108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:27.989976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:27.993047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:27.993539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:27.994016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:27.995159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:27.996589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:27.998279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:28.017651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 98/202] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:27 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:28.023638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:28.122444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca4c79-550f-45dc-b109-dd4c631a594c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:28.148339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:28.153072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:28.176329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:28.179184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:28.179494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:28.179779 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:28.182690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:28.184164 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:28.185881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 105/203] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:27 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:28.192263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:28.214582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352b41d-da30-440f-9706-e7d2ed1903b1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:28.293297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:28.294020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:28.294335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:28.294619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] PATH_INFO: `/v3/users/a8864ffd00b543f1ab93db119ef23347` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:28.296834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] RBAC: Authorizing `identity:get_user(user_id=a8864ffd00b543f1ab93db119ef23347)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:28.298397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:28.303718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 99/204] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:28 2022] GET /identity/v3/users/a8864ffd00b543f1ab93db119ef23347 => generated 290 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:28.305313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:28.351746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb31a48-e4fe-4edf-bfe5-0988b2992b8f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:28.415953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:28.416500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:28.416784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:28.417059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:28.417857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] RBAC: Adding query filter params (role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=4a46e3069ead4bd78735151a29d55ec5) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:28.418167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:28.419660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:28.432909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 106/205] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:28 2022] GET /identity/v3/role_assignments?user.id=4a46e3069ead4bd78735151a29d55ec5&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:28.462573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859ea77-390a-4253-9565-65021bc1cff3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:28.501029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:28.501666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:28.501952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:28.502233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:28.514866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:28.578572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:28.580044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:28.690520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 100/206] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:28.699235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:28.784603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:28.852856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5f30-5a73-4902-b521-050e721959e2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:28.895839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef61de-20d8-40df-a89d-f92bc62619a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:28.897123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef61de-20d8-40df-a89d-f92bc62619a2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:28.897406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef61de-20d8-40df-a89d-f92bc62619a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:28.897685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef61de-20d8-40df-a89d-f92bc62619a2 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:28.898889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef61de-20d8-40df-a89d-f92bc62619a2 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:28.900344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef61de-20d8-40df-a89d-f92bc62619a2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:28.902022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 107/207] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:28 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:28.907859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:28.975058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:29.047360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146662d-ee59-4a60-9aed-92ade0f92af4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:29.084824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48d09-68cf-4384-ba02-c030ba5c2e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:29.085455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48d09-68cf-4384-ba02-c030ba5c2e92 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.085745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48d09-68cf-4384-ba02-c030ba5c2e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.086065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48d09-68cf-4384-ba02-c030ba5c2e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.086897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48d09-68cf-4384-ba02-c030ba5c2e92 None admin] RBAC: Adding query filter params (role.id=c7886317cc6442cf921bd42a66462c1b, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433, user.id=a8864ffd00b543f1ab93db119ef23347) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:29.087275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48d09-68cf-4384-ba02-c030ba5c2e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:29.088731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48d09-68cf-4384-ba02-c030ba5c2e92 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:29.095123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 101/208] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:28 2022] GET /identity/v3/role_assignments?user.id=a8864ffd00b543f1ab93db119ef23347&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=c7886317cc6442cf921bd42a66462c1b => generated 610 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:29.657377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46799-3319-4b86-9912-ce5e06a27836 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.657886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46799-3319-4b86-9912-ce5e06a27836 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.657962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46799-3319-4b86-9912-ce5e06a27836 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.659324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 108/209] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:29.665256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c2dcd-0760-417f-921e-49c8fe8ae7e6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.666122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c2dcd-0760-417f-921e-49c8fe8ae7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.666623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c2dcd-0760-417f-921e-49c8fe8ae7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.690872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1e8c2dcd-0760-417f-921e-49c8fe8ae7e6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:29.692405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e8c2dcd-0760-417f-921e-49c8fe8ae7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:29.703736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ada55e-650a-4a2d-87d8-363e7a90e998 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.704326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ada55e-650a-4a2d-87d8-363e7a90e998 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.704740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ada55e-650a-4a2d-87d8-363e7a90e998 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.706532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 109/210] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:29.713489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf8e5-e617-4262-a803-8c0f456b8700 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.713772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf8e5-e617-4262-a803-8c0f456b8700 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.714044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf8e5-e617-4262-a803-8c0f456b8700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.738678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-037cf8e5-e617-4262-a803-8c0f456b8700 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:29.740932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-037cf8e5-e617-4262-a803-8c0f456b8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:29.774879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 102/211] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:29.801463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c2dcd-0760-417f-921e-49c8fe8ae7e6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:29.817847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 110/212] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:29.819433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d705-6176-48a4-8a75-5a7573d42bec None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.819901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d705-6176-48a4-8a75-5a7573d42bec None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.820367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d705-6176-48a4-8a75-5a7573d42bec None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.821815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 111/213] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:29.826922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d477ff-6d57-42bf-b382-aa611cc5c5f4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.827412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d477ff-6d57-42bf-b382-aa611cc5c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.827885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d477ff-6d57-42bf-b382-aa611cc5c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.838627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:29.846112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c1d477ff-6d57-42bf-b382-aa611cc5c5f4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:29.847408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c1d477ff-6d57-42bf-b382-aa611cc5c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:29.900181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:29.917543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c2dcd-0760-417f-921e-49c8fe8ae7e6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:29.926500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 112/214] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:29.927324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d477ff-6d57-42bf-b382-aa611cc5c5f4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:29.957057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:29.957711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:29.957992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:29.958268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:29.969166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:29.974742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:29.975802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:29.976706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 103/215] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:29.977458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.047182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d477ff-6d57-42bf-b382-aa611cc5c5f4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.081686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.082126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.082814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.083103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.083900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.090295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e113e5-5a8d-4739-8c05-47d921d0ab50 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.094195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:30.099734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:30.100574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:30.101328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:30.105878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 113/216] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:30.106604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.128815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.129636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.129926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.130228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.131616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.133182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.135035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 104/217] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:30.140674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.149805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.212447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b930-353e-4f61-adc6-1fa6f5c6a857 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.238849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459ad40-9ab9-4811-896b-41d4c5fa1a99 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.248912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.249531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.249816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.250091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.250845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:30.251153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.252529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.267532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 114/218] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:30 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:30.267532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.276947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.277662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.277951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.278227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.278982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:30.279289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.280667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.293540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 105/219] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:30.293540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.319294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.383159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095131d-8a1d-444c-89cf-e5acff44cefa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.385031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.399700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b52c32-7f3f-45b7-9bdf-639f00dbda48 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.422958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.423580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.423863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.424134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.424817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.426253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.434873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.435839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.436317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.436642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] PATH_INFO: `/v3/users/c7cd5b6607ce48eeb1eeaa464f0e6db6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.458287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 115/220] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:49:30 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:30.458287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.463138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd5b6607ce48eeb1eeaa464f0e6db6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.464923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.467308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 106/221] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:30 2022] GET /identity/v3/users/c7cd5b6607ce48eeb1eeaa464f0e6db6 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:30.474071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.582400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683945f-7e20-4d3a-93c9-7ca95f283cb8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.594222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.620092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c2c1d-2a80-4fc6-a2df-5b821d0234fc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.623766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.624428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.624715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.624994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] PATH_INFO: `/v3/users/4a46e3069ead4bd78735151a29d55ec5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.626188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] RBAC: Authorizing `identity:get_user(user_id=4a46e3069ead4bd78735151a29d55ec5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.627736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.630292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 116/222] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:30 2022] GET /identity/v3/users/4a46e3069ead4bd78735151a29d55ec5 => generated 284 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:30.637618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.667768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.669228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.669722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.670001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.676587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.770510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.771958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.774160 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c7bca-9887-4313-bc27-d624d9bc822f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:30.822439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:30.823897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:30.824389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:30.824844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:30.826647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:30.828641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:30.830868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 117/223] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:30 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:30.839632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.877847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.910754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 107/224] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:30.916366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:30.964516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:30.972197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7bb8c-2085-4069-af24-3f6d2bf02147 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:31.012783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec691ad-977f-420b-b401-dbf1f10cd7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:31.014026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec691ad-977f-420b-b401-dbf1f10cd7a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.014615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec691ad-977f-420b-b401-dbf1f10cd7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.015075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec691ad-977f-420b-b401-dbf1f10cd7a5 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/4a46e3069ead4bd78735151a29d55ec5/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.017439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec691ad-977f-420b-b401-dbf1f10cd7a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc, user_id=4a46e3069ead4bd78735151a29d55ec5, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:31.019195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec691ad-977f-420b-b401-dbf1f10cd7a5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:31.024383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6d82f-30bd-4b74-a5a7-1b766c27fa1e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:31.036368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 118/225] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:30 2022] PUT /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/4a46e3069ead4bd78735151a29d55ec5/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:49:31.038731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1c40-2bc1-46b3-a9b8-a03b6ee0bb9f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.039287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1c40-2bc1-46b3-a9b8-a03b6ee0bb9f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.039840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1c40-2bc1-46b3-a9b8-a03b6ee0bb9f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.041877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 119/226] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:31.047573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af3f16-8a09-428b-9cd8-79c7f7d101af None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.048186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af3f16-8a09-428b-9cd8-79c7f7d101af None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.048680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af3f16-8a09-428b-9cd8-79c7f7d101af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.062656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:31.063354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.063640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.063918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.065239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:31.066763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:31.069082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 108/227] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:30 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:31.073043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-26af3f16-8a09-428b-9cd8-79c7f7d101af None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:31.074820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-26af3f16-8a09-428b-9cd8-79c7f7d101af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:31.075090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:31.130170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:31.156230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 120/228] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:31.190053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb297d1d-6e14-4535-80f1-da9aba750f5e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:31.196343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af3f16-8a09-428b-9cd8-79c7f7d101af None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:31.273059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:31.273664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.273941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.274219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.275283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=c7cd5b6607ce48eeb1eeaa464f0e6db6) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:31.275371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:31.276796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:31.285425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 109/229] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:31 2022] GET /identity/v3/role_assignments?user.id=c7cd5b6607ce48eeb1eeaa464f0e6db6&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:31.311215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:31.333378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af3f16-8a09-428b-9cd8-79c7f7d101af None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:31.377167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:31.378193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.378712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.379177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.399460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:31.404828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:31.405736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:31.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:31.408629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 121/230] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:31.415687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:31.557241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f606e2-b2c0-4884-ad6f-da74063db157 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:31.572387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:31.603870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:31.604507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.604791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.605065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.605789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:31.606093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:31.607509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:31.617546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 110/231] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:31.623898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:31.799220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef11c1f-47da-4c63-a52d-8b196ca534b0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:31.844027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:31.845039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:31.845529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:31.846009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] PATH_INFO: `/v3/users/4a46e3069ead4bd78735151a29d55ec5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:31.847423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] RBAC: Authorizing `identity:get_user(user_id=4a46e3069ead4bd78735151a29d55ec5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:31.849152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:31.855256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 122/232] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:31 2022] GET /identity/v3/users/4a46e3069ead4bd78735151a29d55ec5 => generated 284 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:31.856520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:32.028505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef68a93-2497-45e9-91e6-a90b50d90c20 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:32.073605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441a83b-fba7-4451-b6a1-b0378e69b445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:32.074286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441a83b-fba7-4451-b6a1-b0378e69b445 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:32.074582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441a83b-fba7-4451-b6a1-b0378e69b445 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:32.074903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441a83b-fba7-4451-b6a1-b0378e69b445 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:32.076921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441a83b-fba7-4451-b6a1-b0378e69b445 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:32.078478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441a83b-fba7-4451-b6a1-b0378e69b445 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:32.080460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 111/233] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:31 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:32.086641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:32.108521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:32.234784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e88e68-645b-42cb-8da6-2e63bfe36473 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:32.275521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e73b3-059e-45a6-a5f5-7a10b35528ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:32.276193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e73b3-059e-45a6-a5f5-7a10b35528ae None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:32.276475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e73b3-059e-45a6-a5f5-7a10b35528ae None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:32.276751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e73b3-059e-45a6-a5f5-7a10b35528ae None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/4a46e3069ead4bd78735151a29d55ec5/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:32.284033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e73b3-059e-45a6-a5f5-7a10b35528ae None admin] RBAC: Authorizing `identity:create_grant(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc, user_id=4a46e3069ead4bd78735151a29d55ec5, role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:32.285490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e73b3-059e-45a6-a5f5-7a10b35528ae None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:32.317110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 123/234] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:32 2022] PUT /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/4a46e3069ead4bd78735151a29d55ec5/roles/0db42c55aa904f95983cff92ac10ac3b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:33.031267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b268c-15f2-4dac-a63a-c38b8702306a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.032276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b268c-15f2-4dac-a63a-c38b8702306a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.032774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b268c-15f2-4dac-a63a-c38b8702306a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.034472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 112/235] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:33.039945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68ea7-fb3d-46be-9fdb-9bba2efa4dc8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.040350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68ea7-fb3d-46be-9fdb-9bba2efa4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.040494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e68ea7-fb3d-46be-9fdb-9bba2efa4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.068616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a5e68ea7-fb3d-46be-9fdb-9bba2efa4dc8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:33.070045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a5e68ea7-fb3d-46be-9fdb-9bba2efa4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:33.137651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df9c5-2fd5-4d25-ae1c-f9b3fa7067dd None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.138420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df9c5-2fd5-4d25-ae1c-f9b3fa7067dd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.138839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06df9c5-2fd5-4d25-ae1c-f9b3fa7067dd None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.140595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 113/236] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:33.145401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7abb7-7f58-4d44-98ca-8b7c52a12172 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.145908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7abb7-7f58-4d44-98ca-8b7c52a12172 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.146348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7abb7-7f58-4d44-98ca-8b7c52a12172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.160238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 124/237] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:33.175501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-00d7abb7-7f58-4d44-98ca-8b7c52a12172 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:33.176904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-00d7abb7-7f58-4d44-98ca-8b7c52a12172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:33.184650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e68ea7-fb3d-46be-9fdb-9bba2efa4dc8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:33.187078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:33.236472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:33.294409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 114/238] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:33.330016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e68ea7-fb3d-46be-9fdb-9bba2efa4dc8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:33.335758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7abb7-7f58-4d44-98ca-8b7c52a12172 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:33.414211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:33.415258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.415745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.416219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.427846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:33.433226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:33.434114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:33.434931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:33.437571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 125/239] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:33.451379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:33.497278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7abb7-7f58-4d44-98ca-8b7c52a12172 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:33.529599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:33.571194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074b938-07f6-48ec-a183-474d138bc970 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:33.580008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:33.580676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.580962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.581239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.586992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:33.588700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:33.590353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 115/240] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:33.596146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:33.612408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:33.613354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.613840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.615109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.618093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:33.619463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:33.621080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:33.642063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 126/241] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:33 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:33.645142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:33.686440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:33.806676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cd780-567e-4bdf-bf16-1d37335efad3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:33.831029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ca619-18f0-4461-9f6a-fbc25f18f774 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:33.860222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:33.874701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87b9fe-bcde-4722-ad47-6958c87b1216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:33.875986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87b9fe-bcde-4722-ad47-6958c87b1216 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.876509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87b9fe-bcde-4722-ad47-6958c87b1216 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.877078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87b9fe-bcde-4722-ad47-6958c87b1216 None admin] PATH_INFO: `/v3/users/e9e103fc66fe426c8f74b02939dab1b3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.894662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87b9fe-bcde-4722-ad47-6958c87b1216 None admin] RBAC: Authorizing `identity:get_user(user_id=e9e103fc66fe426c8f74b02939dab1b3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:33.895518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b992-449e-460b-9c99-3be2ccf6071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:33.897301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b992-449e-460b-9c99-3be2ccf6071b None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.898547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87b9fe-bcde-4722-ad47-6958c87b1216 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:33.898927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b992-449e-460b-9c99-3be2ccf6071b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.899277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b992-449e-460b-9c99-3be2ccf6071b None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.901708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b992-449e-460b-9c99-3be2ccf6071b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:33.903244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b992-449e-460b-9c99-3be2ccf6071b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:33.903457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 127/242] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:33 2022] GET /identity/v3/users/e9e103fc66fe426c8f74b02939dab1b3 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:33.904895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f952a9-bf95-4257-aa29-13423cce83cc None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.905385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f952a9-bf95-4257-aa29-13423cce83cc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.905872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f952a9-bf95-4257-aa29-13423cce83cc None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.907569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 128/243] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:33.911107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f952a9-bf95-4257-aa29-13423cce83cc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:33.929557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 116/244] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:49:33 2022] POST /identity/v3/users => generated 294 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:49:33.931280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e510-477e-43d7-a2e7-fda5d31bb94a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:33.931577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e510-477e-43d7-a2e7-fda5d31bb94a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:33.931860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e510-477e-43d7-a2e7-fda5d31bb94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:33.953149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1dd4e510-477e-43d7-a2e7-fda5d31bb94a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:33.954433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1dd4e510-477e-43d7-a2e7-fda5d31bb94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:34.051799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f952a9-bf95-4257-aa29-13423cce83cc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:34.056841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 117/245] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:34.065888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746203a1-d9d7-413f-b9e5-deb22d3ffe93 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.066389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746203a1-d9d7-413f-b9e5-deb22d3ffe93 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.066680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746203a1-d9d7-413f-b9e5-deb22d3ffe93 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.069347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 118/246] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:34 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:34.074695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b3cf-f94c-4687-984e-5dfb23931abe None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.074983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b3cf-f94c-4687-984e-5dfb23931abe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.075264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9b3cf-f94c-4687-984e-5dfb23931abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.103296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c5c9b3cf-f94c-4687-984e-5dfb23931abe None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:34.104561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c5c9b3cf-f94c-4687-984e-5dfb23931abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:34.105021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:34.105845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.106358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.106960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.139975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:34.171729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:34.194892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 119/247] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:34.195871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b3cf-f94c-4687-984e-5dfb23931abe None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:34.197854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:34.200753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:34.328910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9b3cf-f94c-4687-984e-5dfb23931abe None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:34.338078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 129/248] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:33 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:34.338078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:34.379221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:34.380193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.380984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.381264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.396297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:34.402762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:34.403648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:34.404601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:34.405200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 120/249] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:34.405706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:34.432344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:34.450140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:34.474930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923521e0-3c9d-4022-a644-864601e75490 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:34.517017 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:34.517678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.517964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.518243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.530808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:34.536153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:34.537139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:34.538493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 130/250] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:34.539145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:34.628493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6cd8-c9b6-4d15-acf4-2866688aa08d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:34.651346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b20a8-0eab-4b7c-a00b-9d94a55b388f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:34.690519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:34.691259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.691548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.691828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.693312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:34.693629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:34.695132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:34.704627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 131/251] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:34.705477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:34.710063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:34.722998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:34.723676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.724563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.724843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.727069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:34.728761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:34.731550 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 121/252] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:34.732579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:34.866326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:34.882510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2252f-06a9-4f50-a0be-91321525f78b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:34.883930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d2c26-ced9-412c-9e2f-4c7f3ab15d35 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:34.922096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:34.922775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.923062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.923340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] PATH_INFO: `/v3/users/c7cd5b6607ce48eeb1eeaa464f0e6db6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.924801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd5b6607ce48eeb1eeaa464f0e6db6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:34.926246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:34.928083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 122/253] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/users/c7cd5b6607ce48eeb1eeaa464f0e6db6 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:34.928662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:34.934567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83edb3-1502-425b-950d-f75485070d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:34.935453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83edb3-1502-425b-950d-f75485070d61 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.936054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83edb3-1502-425b-950d-f75485070d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.936523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83edb3-1502-425b-950d-f75485070d61 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.937584 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83edb3-1502-425b-950d-f75485070d61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:34.938087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83edb3-1502-425b-950d-f75485070d61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:34.939685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83edb3-1502-425b-950d-f75485070d61 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:34.950596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 132/254] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:34.952194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017c20-39be-4620-81b8-4d5498e0794a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:34.952756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017c20-39be-4620-81b8-4d5498e0794a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:34.953327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017c20-39be-4620-81b8-4d5498e0794a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:34.954809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 133/255] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:34.955692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017c20-39be-4620-81b8-4d5498e0794a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:35.031314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:35.036382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586352-6b40-4b48-b458-b94cf0cdae84 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:35.071973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:35.073040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.073538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.073920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.074574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017c20-39be-4620-81b8-4d5498e0794a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:35.074945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] RBAC: Adding query filter params (role.id=c7886317cc6442cf921bd42a66462c1b, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=e9e103fc66fe426c8f74b02939dab1b3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:35.075121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:35.076492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:35.085044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 123/256] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/role_assignments?user.id=e9e103fc66fe426c8f74b02939dab1b3&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=c7886317cc6442cf921bd42a66462c1b => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:35.085705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:35.114135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:35.119253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12771bf5-c580-4264-8032-7bb914ddd50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:35.120349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771bf5-c580-4264-8032-7bb914ddd50c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.121134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771bf5-c580-4264-8032-7bb914ddd50c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.122016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771bf5-c580-4264-8032-7bb914ddd50c None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.123730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12771bf5-c580-4264-8032-7bb914ddd50c None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:35.125713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12771bf5-c580-4264-8032-7bb914ddd50c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:35.128169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 134/257] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:34 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:35.129842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548a83-b5e8-4e3c-a12b-de4b3cb08d52 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.130413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548a83-b5e8-4e3c-a12b-de4b3cb08d52 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.130955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8548a83-b5e8-4e3c-a12b-de4b3cb08d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.158776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d8548a83-b5e8-4e3c-a12b-de4b3cb08d52 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:35.160275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d8548a83-b5e8-4e3c-a12b-de4b3cb08d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:35.228201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495031-5fe3-48f6-9005-243dcc755f0f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:35.261257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 135/258] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:35.262683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8548a83-b5e8-4e3c-a12b-de4b3cb08d52 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:35.272511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:35.273172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.273453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.273730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] PATH_INFO: `/v3/users/4a46e3069ead4bd78735151a29d55ec5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.279062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] RBAC: Authorizing `identity:get_user(user_id=4a46e3069ead4bd78735151a29d55ec5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:35.280639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:35.282773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 124/259] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:35 2022] GET /identity/v3/users/4a46e3069ead4bd78735151a29d55ec5 => generated 284 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:35.291032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:35.344764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:35.393485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8548a83-b5e8-4e3c-a12b-de4b3cb08d52 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:35.433294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:35.434348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.434826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.435411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/c7cd5b6607ce48eeb1eeaa464f0e6db6/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.437638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] RBAC: Authorizing `identity:create_grant(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc, user_id=c7cd5b6607ce48eeb1eeaa464f0e6db6, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:35.439481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:35.457950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 136/260] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:35 2022] PUT /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/c7cd5b6607ce48eeb1eeaa464f0e6db6/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:35.462419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:35.498816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:35.526277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc863c19-ef89-4e78-b3e7-fb8d616f3c8b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:35.596197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:35.596919 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.597202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.597475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.683757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:35.685179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:35.760334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfd035-b394-40e6-9c6e-6df687ae8fbc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:35.791995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:35.803342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 125/261] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:35.805295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:35.825907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:35.856074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:35.856734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.857020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.857294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.877496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:35.882995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:35.883883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:35.884663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:35.896886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 137/262] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:35.903757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:35.925153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a33a-4bd1-4c2b-a129-651d278540a7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:35.960922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:35.961815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:35.962244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:35.962710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:35.964015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:35.965592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:35.967524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 126/263] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:35 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:35.973473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:36.030724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:36.076165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324546-2b85-48fd-a11c-04ce9897b95a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:36.112373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:36.113362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:36.113842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:36.114373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:36.115390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=4a46e3069ead4bd78735151a29d55ec5) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:36.115899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:36.117531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:36.126362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 127/264] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:35 2022] GET /identity/v3/role_assignments?user.id=4a46e3069ead4bd78735151a29d55ec5&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:36.180222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e700e-1f86-4dfc-b844-650b1864cdd0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:36.228234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:36.228797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:36.229084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:36.229365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:36.230289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:36.230611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:36.232096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:36.247149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 138/265] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:35 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:36.253132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:36.373877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64822-d8da-48df-b4e0-9e53a5df59ae None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:36.393579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:36.412346 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:36.413002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:36.413287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:36.413565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] PATH_INFO: `/v3/users/4a46e3069ead4bd78735151a29d55ec5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:36.414857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] RBAC: Authorizing `identity:get_user(user_id=4a46e3069ead4bd78735151a29d55ec5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:36.416414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:36.422391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 128/266] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:36 2022] GET /identity/v3/users/4a46e3069ead4bd78735151a29d55ec5 => generated 284 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:36.427480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:36.477803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:36.534145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574caaa7-66f4-4c35-b805-0b60827886c2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:36.568955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:36.569585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:36.569867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:36.570146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:36.650610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:36.652086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:36.709369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:36.772491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 139/267] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:36.777864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:36.922772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00c585-1479-4c60-8ce5-89c34b896695 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:36.968062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d55071-18b1-4433-a7a2-2fc12b2fb456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:36.968722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d55071-18b1-4433-a7a2-2fc12b2fb456 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:36.969008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d55071-18b1-4433-a7a2-2fc12b2fb456 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:36.969283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d55071-18b1-4433-a7a2-2fc12b2fb456 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:36.970495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d55071-18b1-4433-a7a2-2fc12b2fb456 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:36.971944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d55071-18b1-4433-a7a2-2fc12b2fb456 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:36.978385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 129/268] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:36 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:36.980441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.003707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590aac-32a7-4845-a074-4d239d346aeb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.004000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590aac-32a7-4845-a074-4d239d346aeb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.004276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590aac-32a7-4845-a074-4d239d346aeb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.005951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 130/269] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:37.010505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1aece-4f0b-4582-a6e9-2bbf223bdb20 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.010788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1aece-4f0b-4582-a6e9-2bbf223bdb20 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.011064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1aece-4f0b-4582-a6e9-2bbf223bdb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.033069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-10f1aece-4f0b-4582-a6e9-2bbf223bdb20 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:37.034297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10f1aece-4f0b-4582-a6e9-2bbf223bdb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:37.130626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:37.155944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 131/270] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:37.167502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8910736-8c8d-4cc2-9f86-bc0dd941b321 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:37.187606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1aece-4f0b-4582-a6e9-2bbf223bdb20 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.237412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16070db-64c2-4edf-9421-8d2ad1f3c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:37.238061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16070db-64c2-4edf-9421-8d2ad1f3c676 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.238340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16070db-64c2-4edf-9421-8d2ad1f3c676 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.238619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16070db-64c2-4edf-9421-8d2ad1f3c676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.239447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16070db-64c2-4edf-9421-8d2ad1f3c676 None admin] RBAC: Adding query filter params (role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=4a46e3069ead4bd78735151a29d55ec5) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:37.240372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16070db-64c2-4edf-9421-8d2ad1f3c676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:37.241946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16070db-64c2-4edf-9421-8d2ad1f3c676 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:37.267776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 140/271] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:36 2022] GET /identity/v3/role_assignments?user.id=4a46e3069ead4bd78735151a29d55ec5&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 610 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:37.281441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f231a-07a5-41b2-9d01-f2dded53bf4d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.281754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f231a-07a5-41b2-9d01-f2dded53bf4d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.282015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f231a-07a5-41b2-9d01-f2dded53bf4d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.283558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 141/272] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:37.289391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857349b-72c7-4d67-8575-171880ad98c2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.289696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857349b-72c7-4d67-8575-171880ad98c2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.289959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857349b-72c7-4d67-8575-171880ad98c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.323466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e857349b-72c7-4d67-8575-171880ad98c2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:37.324925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e857349b-72c7-4d67-8575-171880ad98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:37.327738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1aece-4f0b-4582-a6e9-2bbf223bdb20 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:37.346830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:37.375816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:37.376498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.376778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.377047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.402946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:37.413540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:37.414517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:37.415332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 132/273] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:37.429050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.472298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 142/274] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:37.504553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:37.510776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857349b-72c7-4d67-8575-171880ad98c2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.564883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186105e8-769c-4e9c-8748-5c148bace858 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:37.603095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:37.603735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.604020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.604307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.605034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:37.605343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:37.606790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:37.615730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 133/275] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:37.622531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.629832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857349b-72c7-4d67-8575-171880ad98c2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:37.682782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdb6fd-874d-4983-83c5-d6e9dc1f1be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:37.683875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdb6fd-874d-4983-83c5-d6e9dc1f1be3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.684443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdb6fd-874d-4983-83c5-d6e9dc1f1be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.684921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdb6fd-874d-4983-83c5-d6e9dc1f1be3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.686303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdb6fd-874d-4983-83c5-d6e9dc1f1be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:37.688175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdb6fd-874d-4983-83c5-d6e9dc1f1be3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:37.690311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 143/276] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:37 2022] GET /identity/v3/domains/default => generated 200 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:37.691657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f60fc-3ab9-48cf-8e3f-1ce938a40e3b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.691940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f60fc-3ab9-48cf-8e3f-1ce938a40e3b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.692214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f60fc-3ab9-48cf-8e3f-1ce938a40e3b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.694322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 144/277] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:37.699353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633f4e-b01e-452c-b847-8fe184b454bf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.699643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633f4e-b01e-452c-b847-8fe184b454bf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.700275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633f4e-b01e-452c-b847-8fe184b454bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.720580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9e633f4e-b01e-452c-b847-8fe184b454bf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:37.721770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9e633f4e-b01e-452c-b847-8fe184b454bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:37.724858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:37.752123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff937-a701-4485-aa70-f50e80c9b19d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:37.760185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:37.791807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:37.792573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.792926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.793283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] PATH_INFO: `/v3/users/197f4792347347ab82df264f824c313b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.801844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 145/278] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:37.807215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] RBAC: Authorizing `identity:get_user(user_id=197f4792347347ab82df264f824c313b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:37.808682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:37.810503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 134/279] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:37 2022] GET /identity/v3/users/197f4792347347ab82df264f824c313b => generated 294 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:37.811125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633f4e-b01e-452c-b847-8fe184b454bf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.817050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.927030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b814-7896-4800-b33f-b832420393a6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:37.930759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633f4e-b01e-452c-b847-8fe184b454bf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:37.963472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:37.964016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.964297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.964572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.965349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, user.id=197f4792347347ab82df264f824c313b, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:37.965657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:37.967192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:37.968498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee6482-22ec-4e67-a9f6-5b8d5f4ffab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:37.969129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee6482-22ec-4e67-a9f6-5b8d5f4ffab9 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:37.969418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee6482-22ec-4e67-a9f6-5b8d5f4ffab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:37.969704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee6482-22ec-4e67-a9f6-5b8d5f4ffab9 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:37.970435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee6482-22ec-4e67-a9f6-5b8d5f4ffab9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:37.971903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee6482-22ec-4e67-a9f6-5b8d5f4ffab9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:37.972842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 135/280] 10.222.0.121 () {56 vars in 1313 bytes} [Mon Aug 1 16:49:37 2022] GET /identity/v3/role_assignments?user.id=197f4792347347ab82df264f824c313b&scope.system=all&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 227 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:37.979401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:37.984050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.003249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 146/281] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:49:37 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:38.042842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.125184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2372cd-b316-4992-b72f-b1de732876dd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.147684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2446e-40fe-4d40-a5ca-c74405e09cb7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.148029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2446e-40fe-4d40-a5ca-c74405e09cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.148316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2446e-40fe-4d40-a5ca-c74405e09cb7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.149870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 147/282] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:38.156930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d877c-56ea-4dfb-abc8-c25b9923d523 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.157224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d877c-56ea-4dfb-abc8-c25b9923d523 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.157509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d877c-56ea-4dfb-abc8-c25b9923d523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.165089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.165777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.166139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.166492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.178606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:38.182391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c86d877c-56ea-4dfb-abc8-c25b9923d523 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:38.183765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:38.184655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:38.185878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 136/283] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:38.187292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c86d877c-56ea-4dfb-abc8-c25b9923d523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:38.190963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.273581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 148/284] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:38.292134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.302890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d877c-56ea-4dfb-abc8-c25b9923d523 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.306180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ca8ab-bd5d-40a0-b4ec-b05bd49b38f8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.348272 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.348971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.349258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.349534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.350250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:38.350591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:38.351983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:38.363721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 137/285] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:38 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:38.370060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.436563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d877c-56ea-4dfb-abc8-c25b9923d523 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.463375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.480053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.481080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.481599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.482059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.492327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09073c98-85bb-4271-9dd4-a5797acd40ca None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.496921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:38.502200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:38.503081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:38.503867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:38.506749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 149/286] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:38.514025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.549332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.550299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.550804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.551261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] PATH_INFO: `/v3/users/e9e103fc66fe426c8f74b02939dab1b3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.553340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=e9e103fc66fe426c8f74b02939dab1b3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:38.555066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:38.557280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 138/287] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:38 2022] GET /identity/v3/users/e9e103fc66fe426c8f74b02939dab1b3 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:38.562823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.586791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.654705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ca1ad-b787-4b65-aad7-b4592577428d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.686196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1ef36-8b8f-417e-bfdd-d74e69459cc7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.694064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.694950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.695436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.696000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.697122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:38.697634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:38.699622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:38.709837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 150/288] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:38 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:38.728348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.730068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.730754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.731038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.731317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.732501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:38.735570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:38.741551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 139/289] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:38 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:38.742878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.830069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.905434 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d337a-b676-4bc1-ad5d-19e07c840731 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.905806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.925850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64728-511c-421c-896d-dc8638bf843f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:38.942335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.945340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.945799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.946275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] PATH_INFO: `/v3/users/c7cd5b6607ce48eeb1eeaa464f0e6db6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.951853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd5b6607ce48eeb1eeaa464f0e6db6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:38.953678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:38.956930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 151/290] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:38 2022] GET /identity/v3/users/c7cd5b6607ce48eeb1eeaa464f0e6db6 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:38.963605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:38.992190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:38.993140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:38.993566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:38.993984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/e9e103fc66fe426c8f74b02939dab1b3/roles/c7886317cc6442cf921bd42a66462c1b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:38.997227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc, user_id=e9e103fc66fe426c8f74b02939dab1b3, role_id=c7886317cc6442cf921bd42a66462c1b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:38.999594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:39.023559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 140/291] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:49:38 2022] PUT /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/users/e9e103fc66fe426c8f74b02939dab1b3/roles/c7886317cc6442cf921bd42a66462c1b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:39.104812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0051-98de-4bbc-bcfc-62d77f2ada47 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:39.120701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:39.152314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:39.153230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:39.153661 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:39.154081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:39.251419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:39.253171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:39.365248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 152/292] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:39.370730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:39.479831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0bcb4-5c23-4aed-b3be-5b3bfd031ac0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:39.523732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9e350-cb9b-4747-8721-afde1f4e760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:39.524628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9e350-cb9b-4747-8721-afde1f4e760b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:39.525080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9e350-cb9b-4747-8721-afde1f4e760b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:39.525500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9e350-cb9b-4747-8721-afde1f4e760b None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:39.530117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9e350-cb9b-4747-8721-afde1f4e760b None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:39.531875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9e350-cb9b-4747-8721-afde1f4e760b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:39.533705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 141/293] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:39 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:39.540356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:39.559386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:39.674284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7cb24-481e-4c2b-859c-3d78510395b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:39.720826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5907416-fee1-4df6-950f-831820cb416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:39.721459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907416-fee1-4df6-950f-831820cb416c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:39.721740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907416-fee1-4df6-950f-831820cb416c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:39.722014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5907416-fee1-4df6-950f-831820cb416c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:39.722894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907416-fee1-4df6-950f-831820cb416c None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=c7cd5b6607ce48eeb1eeaa464f0e6db6) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:39.723206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907416-fee1-4df6-950f-831820cb416c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:39.725353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5907416-fee1-4df6-950f-831820cb416c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:39.738292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 153/294] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:39 2022] GET /identity/v3/role_assignments?user.id=c7cd5b6607ce48eeb1eeaa464f0e6db6&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 610 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:40.211316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e308a-2ffe-48ef-b85f-fc2ded2283bf None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:40.211607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e308a-2ffe-48ef-b85f-fc2ded2283bf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:40.211892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e308a-2ffe-48ef-b85f-fc2ded2283bf None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:40.213387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 142/295] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:40.221838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21713c40-b80b-430e-a129-1150e5b9c0fc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:40.221838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21713c40-b80b-430e-a129-1150e5b9c0fc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:40.221838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21713c40-b80b-430e-a129-1150e5b9c0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:40.238564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-21713c40-b80b-430e-a129-1150e5b9c0fc None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:40.240590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-21713c40-b80b-430e-a129-1150e5b9c0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:40.310303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 154/296] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:40.334220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e308a-2ffe-48ef-b85f-fc2ded2283bf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:40.350794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:40.454491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e308a-2ffe-48ef-b85f-fc2ded2283bf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:40.495404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:40.495988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:40.496269 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:40.496541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:40.507699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:40.514092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:40.515015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:40.515818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 143/297] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:40.521055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21713c40-b80b-430e-a129-1150e5b9c0fc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:40.531612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:40.627302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21713c40-b80b-430e-a129-1150e5b9c0fc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:40.663925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebc50d-fc2e-4b5e-a10a-a077d8f4a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:40.664603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebc50d-fc2e-4b5e-a10a-a077d8f4a42c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:40.664886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebc50d-fc2e-4b5e-a10a-a077d8f4a42c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:40.665159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebc50d-fc2e-4b5e-a10a-a077d8f4a42c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:40.665967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebc50d-fc2e-4b5e-a10a-a077d8f4a42c None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:40.666289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebc50d-fc2e-4b5e-a10a-a077d8f4a42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:40.667681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebc50d-fc2e-4b5e-a10a-a077d8f4a42c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:40.676339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 155/298] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:40 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:40.682237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:40.733089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25917a-3001-4049-9396-4ed6d679500f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:40.733487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25917a-3001-4049-9396-4ed6d679500f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:40.733767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25917a-3001-4049-9396-4ed6d679500f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:40.735540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 156/299] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:40.741009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334cac-af97-4498-bfe2-9b2845837935 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:40.741522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334cac-af97-4498-bfe2-9b2845837935 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:40.742006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334cac-af97-4498-bfe2-9b2845837935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:40.760915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4f334cac-af97-4498-bfe2-9b2845837935 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:40.762538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4f334cac-af97-4498-bfe2-9b2845837935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:40.773689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:40.802580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518bd53-48f4-4b9d-b5e4-e6ecf857d67a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:40.838906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:40.839936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:40.840430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:40.840909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] PATH_INFO: `/v3/users/197f4792347347ab82df264f824c313b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:40.842433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] RBAC: Authorizing `identity:get_user(user_id=197f4792347347ab82df264f824c313b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:40.844137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:40.845969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 144/300] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:40 2022] GET /identity/v3/users/197f4792347347ab82df264f824c313b => generated 294 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:40.846475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:40.853163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:40.862645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 157/301] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:40.886276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334cac-af97-4498-bfe2-9b2845837935 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:40.963613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab3e8-36fe-4eed-924c-cfe45a339208 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:40.999732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334cac-af97-4498-bfe2-9b2845837935 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:41.001349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e2c5-5e73-4560-a00c-aefacf399b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.002025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e2c5-5e73-4560-a00c-aefacf399b67 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.002353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e2c5-5e73-4560-a00c-aefacf399b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.002638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e2c5-5e73-4560-a00c-aefacf399b67 None admin] PATH_INFO: `/v3/system/users/197f4792347347ab82df264f824c313b/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.004102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620e2c5-5e73-4560-a00c-aefacf399b67 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=197f4792347347ab82df264f824c313b, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:41.006012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620e2c5-5e73-4560-a00c-aefacf399b67 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:41.024131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 145/302] 10.222.0.121 () {58 vars in 1339 bytes} [Mon Aug 1 16:49:40 2022] PUT /identity/v3/system/users/197f4792347347ab82df264f824c313b/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:49:41.024131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721a7b-383d-4342-a759-2f62b6325567 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.024131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721a7b-383d-4342-a759-2f62b6325567 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.024131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721a7b-383d-4342-a759-2f62b6325567 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.024131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 146/303] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:41.026567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff48f-011b-4a91-bb3e-2dc3a735a838 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.026955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff48f-011b-4a91-bb3e-2dc3a735a838 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.027309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff48f-011b-4a91-bb3e-2dc3a735a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.043785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:41.050196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.051380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.051665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.052026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.052407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2ceff48f-011b-4a91-bb3e-2dc3a735a838 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:41.055291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ceff48f-011b-4a91-bb3e-2dc3a735a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:41.066877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:41.073273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:41.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:41.075035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 158/304] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:41.084385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:41.154290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 147/305] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:41.169385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:41.178822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff48f-011b-4a91-bb3e-2dc3a735a838 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:41.218845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b219347-8ca5-4643-b5f1-79b255ffc630 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:41.265564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.266198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.266514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.266792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.267572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:41.268328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:41.269739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:41.281679 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 159/306] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:41 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:41.287259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:41.296313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff48f-011b-4a91-bb3e-2dc3a735a838 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:41.341641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.342330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.343091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.343381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.344802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:41.346896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:41.348950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 148/307] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:41.354813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:41.359796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:41.420592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d7497-bb39-4f13-864e-6e89494d3979 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:41.449107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:41.463788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.464638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.465141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.465486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] PATH_INFO: `/v3/users/f5e3426c504d4171a68b2a05530f86c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.481449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f5e3426c504d4171a68b2a05530f86c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:41.483455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:41.486670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c8b1-7dce-47e3-8f99-6d5c71f52967 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:41.490721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 160/308] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:41 2022] GET /identity/v3/users/f5e3426c504d4171a68b2a05530f86c5 => generated 294 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:41.492095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:41.526901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870540aa-58e6-4412-9da5-3dfac52b16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.527535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870540aa-58e6-4412-9da5-3dfac52b16db None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.527815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870540aa-58e6-4412-9da5-3dfac52b16db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.528088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870540aa-58e6-4412-9da5-3dfac52b16db None admin] PATH_INFO: `/v3/groups` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.528751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870540aa-58e6-4412-9da5-3dfac52b16db None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:41.530285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870540aa-58e6-4412-9da5-3dfac52b16db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:41.548078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 149/309] 10.222.0.121 () {60 vars in 1139 bytes} [Mon Aug 1 16:49:41 2022] POST /identity/v3/groups => generated 230 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:49:41.549539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa642-dcad-47bb-b050-5dc273b3d9d1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.549976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa642-dcad-47bb-b050-5dc273b3d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.550432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa642-dcad-47bb-b050-5dc273b3d9d1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.551869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 150/310] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:41.557496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af44df-d25f-4bc7-956b-ac5637e66aa0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.557784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af44df-d25f-4bc7-956b-ac5637e66aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.558067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af44df-d25f-4bc7-956b-ac5637e66aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.587442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-56af44df-d25f-4bc7-956b-ac5637e66aa0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:41.589944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-56af44df-d25f-4bc7-956b-ac5637e66aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:41.621773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611b7f-80c7-4ba2-a650-d7a42a59f8d4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:41.666809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:41.678307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.679249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.679673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.680249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.681248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] RBAC: Adding query filter params (role.id=c7886317cc6442cf921bd42a66462c1b, user.id=f5e3426c504d4171a68b2a05530f86c5, scope.system=all) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:41.681835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:41.682546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 151/311] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:41.684078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:41.690581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 161/312] 10.222.0.121 () {56 vars in 1313 bytes} [Mon Aug 1 16:49:41 2022] GET /identity/v3/role_assignments?user.id=f5e3426c504d4171a68b2a05530f86c5&scope.system=all&role.id=c7886317cc6442cf921bd42a66462c1b => generated 227 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:41.707274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af44df-d25f-4bc7-956b-ac5637e66aa0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:41.827430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af44df-d25f-4bc7-956b-ac5637e66aa0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:41.864935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:41.865597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:41.865883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:41.866159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:41.876591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:41.887282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:41.888385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:41.889189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 152/313] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:41.894674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:41.946168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:42.003584 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a97e9-d56b-4dd4-b568-cbf116e96094 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:42.039912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:42.041021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:42.041549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:42.042019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:42.043142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:42.043658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:42.045241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:42.054955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 162/314] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:41 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:42.060195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:42.123494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:42.169065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1840f-b2cf-422a-afd4-fffa70fc39a0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:42.207618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:42.208363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:42.208717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:42.209004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] PATH_INFO: `/v3/users/e9e103fc66fe426c8f74b02939dab1b3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:42.210349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] RBAC: Authorizing `identity:get_user(user_id=e9e103fc66fe426c8f74b02939dab1b3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:42.211842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:42.213692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 153/315] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:42 2022] GET /identity/v3/users/e9e103fc66fe426c8f74b02939dab1b3 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:42.219163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:42.325508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262d91e-9430-40a6-8d74-c7aaaa53cff7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:42.332650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:42.367167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:42.367797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:42.368081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:42.368358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:42.438904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:42.440362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:42.542411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 163/316] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:42.547804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:42.655641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140ed8f-931d-4017-8098-1409404c719a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:42.683073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:42.696125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbacc0-9250-4da3-8d53-68ba9ecc1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:42.696765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbacc0-9250-4da3-8d53-68ba9ecc1a68 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:42.697055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbacc0-9250-4da3-8d53-68ba9ecc1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:42.697334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbacc0-9250-4da3-8d53-68ba9ecc1a68 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:42.698543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbacc0-9250-4da3-8d53-68ba9ecc1a68 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:42.699991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbacc0-9250-4da3-8d53-68ba9ecc1a68 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:42.701661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 154/317] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:42 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:42.707712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:42.726654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:42.814575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e997f36-55e7-4ac1-9eed-4d6126922e64 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:42.851727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc512eb-7574-4d1c-b77a-b5dcc5344e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:42.852351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc512eb-7574-4d1c-b77a-b5dcc5344e77 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:42.852633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc512eb-7574-4d1c-b77a-b5dcc5344e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:42.852908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc512eb-7574-4d1c-b77a-b5dcc5344e77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:42.853891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc512eb-7574-4d1c-b77a-b5dcc5344e77 None admin] RBAC: Adding query filter params (role.id=c7886317cc6442cf921bd42a66462c1b, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc, user.id=e9e103fc66fe426c8f74b02939dab1b3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:42.854199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc512eb-7574-4d1c-b77a-b5dcc5344e77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:42.855776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc512eb-7574-4d1c-b77a-b5dcc5344e77 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:42.861825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 164/318] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:49:42 2022] GET /identity/v3/role_assignments?user.id=e9e103fc66fe426c8f74b02939dab1b3&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=c7886317cc6442cf921bd42a66462c1b => generated 610 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:43.153140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6005d-baec-49fd-8a18-e2c70d75641b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.153492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6005d-baec-49fd-8a18-e2c70d75641b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.153666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6005d-baec-49fd-8a18-e2c70d75641b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.155199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 155/319] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:43.160049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15689-9690-4d97-820c-76cda7272aa1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.160346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15689-9690-4d97-820c-76cda7272aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.160624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15689-9690-4d97-820c-76cda7272aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.179956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6db15689-9690-4d97-820c-76cda7272aa1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:43.181151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6db15689-9690-4d97-820c-76cda7272aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:43.247619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:43.253463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 165/320] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:43.277735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6005d-baec-49fd-8a18-e2c70d75641b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:43.382737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6005d-baec-49fd-8a18-e2c70d75641b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:43.418249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:43.418864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.419150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.419429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.430366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:43.435493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:43.436364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:43.437140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:43.438496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 156/321] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:43.443139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15689-9690-4d97-820c-76cda7272aa1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:43.546800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15689-9690-4d97-820c-76cda7272aa1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:43.581535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5ac07-c8fd-412f-9ed8-b3f9dc5f5fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:43.582165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5ac07-c8fd-412f-9ed8-b3f9dc5f5fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.582474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5ac07-c8fd-412f-9ed8-b3f9dc5f5fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.582758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5ac07-c8fd-412f-9ed8-b3f9dc5f5fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.583999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5ac07-c8fd-412f-9ed8-b3f9dc5f5fe3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:43.584308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5ac07-c8fd-412f-9ed8-b3f9dc5f5fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:43.585695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5ac07-c8fd-412f-9ed8-b3f9dc5f5fe3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:43.594109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 166/322] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:43.600207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:43.652668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:43.701361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57507e21-16d4-48a0-a39a-31903ee2a423 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.701986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57507e21-16d4-48a0-a39a-31903ee2a423 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.702401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57507e21-16d4-48a0-a39a-31903ee2a423 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.703845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 167/323] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:43.704550 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e98ce-4410-406e-8b3e-3b29446c5fcb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:43.708673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bd561-f7b3-4335-bc21-f06095d3f189 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.709113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bd561-f7b3-4335-bc21-f06095d3f189 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.709295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bd561-f7b3-4335-bc21-f06095d3f189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.727831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dd3bd561-f7b3-4335-bc21-f06095d3f189 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:43.729028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dd3bd561-f7b3-4335-bc21-f06095d3f189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:43.741924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:43.742921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.743370 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.743930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] PATH_INFO: `/v3/users/197f4792347347ab82df264f824c313b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.745984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] RBAC: Authorizing `identity:get_user(user_id=197f4792347347ab82df264f824c313b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:43.748075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:43.750649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 157/324] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:43 2022] GET /identity/v3/users/197f4792347347ab82df264f824c313b => generated 294 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:43.756285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:43.793746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:43.806557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 168/325] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:43.807813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f9dde-a89a-4794-8d03-ba92a684096d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.808126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f9dde-a89a-4794-8d03-ba92a684096d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.808403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f9dde-a89a-4794-8d03-ba92a684096d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.809656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 169/326] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:43.814509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e255-b05a-4fff-82be-e56b3eba04a2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.814800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e255-b05a-4fff-82be-e56b3eba04a2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.815080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e255-b05a-4fff-82be-e56b3eba04a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.832455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c733e255-b05a-4fff-82be-e56b3eba04a2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:43.833669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c733e255-b05a-4fff-82be-e56b3eba04a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:43.860071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e121bb-f6f8-4d31-953d-3805e381a246 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:43.877118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:43.894847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:43.895535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:43.895821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:43.896101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:43.896895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] RBAC: Adding query filter params (role.id=75e3e827b8d74897a0500ac1c262a078, user.id=197f4792347347ab82df264f824c313b, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:43.897209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:43.898666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:43.901089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 170/327] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:43.907568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e255-b05a-4fff-82be-e56b3eba04a2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:43.910291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 158/328] 10.222.0.121 () {56 vars in 1313 bytes} [Mon Aug 1 16:49:43 2022] GET /identity/v3/role_assignments?user.id=197f4792347347ab82df264f824c313b&scope.system=all&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 512 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:43.923700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:44.020481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e255-b05a-4fff-82be-e56b3eba04a2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:44.038979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9d39-a867-4783-b4c4-04ac8ebfa86f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:44.046995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:44.059523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:44.060180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:44.060465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:44.060744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:44.062325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:44.063745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:44.065013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 171/329] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:49:43 2022] GET /identity/v3/domains/default => generated 200 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:44.071107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:44.080435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:44.081100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:44.081387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:44.081666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:44.097518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:44.103040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:44.103982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:44.104796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 159/330] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:44.110243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:44.148804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:44.183490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c562-0a10-4953-bfa2-0f9c16bd0d40 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:44.211908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6ed2-4979-48a6-bf35-7c5b08a6898f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:44.217430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:44.218055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:44.218370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:44.218655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] PATH_INFO: `/v3/groups` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:44.219318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:44.220758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:44.236574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 172/331] 10.222.0.121 () {60 vars in 1139 bytes} [Mon Aug 1 16:49:44 2022] POST /identity/v3/groups => generated 227 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:49:44.250538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:44.250538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:44.250538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:44.250538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:44.250883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:44.250883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:44.251030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:44.260817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 160/332] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:44 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:44.266913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:44.321712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:44.375022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269e72e-57d6-4c13-8e85-17046e25f791 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:44.410175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571aeba0-d0e8-4f34-9d51-412b3fb2f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:44.410878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aeba0-d0e8-4f34-9d51-412b3fb2f451 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:44.411221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aeba0-d0e8-4f34-9d51-412b3fb2f451 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:44.411507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aeba0-d0e8-4f34-9d51-412b3fb2f451 None admin] PATH_INFO: `/v3/users/f5e3426c504d4171a68b2a05530f86c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:44.412694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571aeba0-d0e8-4f34-9d51-412b3fb2f451 None admin] RBAC: Authorizing `identity:get_user(user_id=f5e3426c504d4171a68b2a05530f86c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:44.414163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571aeba0-d0e8-4f34-9d51-412b3fb2f451 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:44.415812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 173/333] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:44 2022] GET /identity/v3/users/f5e3426c504d4171a68b2a05530f86c5 => generated 294 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:44.421474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:44.526228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:44.530683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6be67d-9d2a-4dfc-bc42-e1dc73837fcf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:44.568862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf907f-c572-44d2-b640-25c336a2842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:44.569543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf907f-c572-44d2-b640-25c336a2842d None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:44.569828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf907f-c572-44d2-b640-25c336a2842d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:44.570113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf907f-c572-44d2-b640-25c336a2842d None admin] PATH_INFO: `/v3/system/users/f5e3426c504d4171a68b2a05530f86c5/roles/c7886317cc6442cf921bd42a66462c1b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:44.571777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf907f-c572-44d2-b640-25c336a2842d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f5e3426c504d4171a68b2a05530f86c5, role_id=c7886317cc6442cf921bd42a66462c1b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:44.573121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf907f-c572-44d2-b640-25c336a2842d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:44.582672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 161/334] 10.222.0.121 () {58 vars in 1339 bytes} [Mon Aug 1 16:49:44 2022] PUT /identity/v3/system/users/f5e3426c504d4171a68b2a05530f86c5/roles/c7886317cc6442cf921bd42a66462c1b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:46.643272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31ae2b-8275-4d44-a422-754bcff34acd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:46.643914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31ae2b-8275-4d44-a422-754bcff34acd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:46.643914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31ae2b-8275-4d44-a422-754bcff34acd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:46.645189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 174/335] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:46.652041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210e69-eaf7-4ec4-9a46-9425be82a2ce None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:46.652659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210e69-eaf7-4ec4-9a46-9425be82a2ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:46.652659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210e69-eaf7-4ec4-9a46-9425be82a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:46.679396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ee210e69-eaf7-4ec4-9a46-9425be82a2ce None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:46.680612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ee210e69-eaf7-4ec4-9a46-9425be82a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:46.745672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06fa46-a492-4bfb-b332-3da8036eec77 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:46.745989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06fa46-a492-4bfb-b332-3da8036eec77 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:46.746240 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06fa46-a492-4bfb-b332-3da8036eec77 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:46.749019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 175/336] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:46.754107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69fac4-da25-4385-bc7d-8ff2343cc304 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:46.754439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69fac4-da25-4385-bc7d-8ff2343cc304 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:46.755259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69fac4-da25-4385-bc7d-8ff2343cc304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:46.768349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 162/337] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:46.795329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd69fac4-da25-4385-bc7d-8ff2343cc304 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:46.796558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd69fac4-da25-4385-bc7d-8ff2343cc304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:46.821971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210e69-eaf7-4ec4-9a46-9425be82a2ce None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:46.924895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 176/338] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:46.967762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69fac4-da25-4385-bc7d-8ff2343cc304 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:46.998855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210e69-eaf7-4ec4-9a46-9425be82a2ce None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:47.002650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:47.045229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:47.045891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.046171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.046488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.069646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:47.076279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:47.077214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:47.078010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:47.078786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 163/339] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:47.087505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:47.093290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:47.180175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69fac4-da25-4385-bc7d-8ff2343cc304 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:47.266073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428eeb2-c06c-49d6-9aa0-f90bdbc4cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:47.266769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428eeb2-c06c-49d6-9aa0-f90bdbc4cdab None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.267049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428eeb2-c06c-49d6-9aa0-f90bdbc4cdab None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.267321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428eeb2-c06c-49d6-9aa0-f90bdbc4cdab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.284608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad15d22-2f82-43ca-8041-ab4fc5fd583a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:47.290141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428eeb2-c06c-49d6-9aa0-f90bdbc4cdab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a428eeb2-c06c-49d6-9aa0-f90bdbc4cdab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:47.295509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:47.296403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:47.297621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 177/340] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:47.299481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4623-fa15-47a7-865a-d5d3fdadec5d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.299481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4623-fa15-47a7-865a-d5d3fdadec5d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.299481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4623-fa15-47a7-865a-d5d3fdadec5d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.300806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 178/341] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:47.306050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b4623-fa15-47a7-865a-d5d3fdadec5d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:47.336666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa718c-3788-4c0c-b51e-3dd1199540fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:47.337356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa718c-3788-4c0c-b51e-3dd1199540fd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.337741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa718c-3788-4c0c-b51e-3dd1199540fd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.338014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa718c-3788-4c0c-b51e-3dd1199540fd None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.338927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa718c-3788-4c0c-b51e-3dd1199540fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:47.339228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa718c-3788-4c0c-b51e-3dd1199540fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:47.340604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa718c-3788-4c0c-b51e-3dd1199540fd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:47.357018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 164/342] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:47.358292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8869-e1d8-418c-92ac-3876ff7b7ca1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.358591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8869-e1d8-418c-92ac-3876ff7b7ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.358869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8869-e1d8-418c-92ac-3876ff7b7ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.378211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c0de8869-e1d8-418c-92ac-3876ff7b7ca1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:47.379569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c0de8869-e1d8-418c-92ac-3876ff7b7ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:47.390954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:47.458484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b4623-fa15-47a7-865a-d5d3fdadec5d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:47.464768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 165/343] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:47.466038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711c90-68a9-4464-ba74-ecaaaa5705b4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.469868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:47.470417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711c90-68a9-4464-ba74-ecaaaa5705b4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.470757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711c90-68a9-4464-ba74-ecaaaa5705b4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.472055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 166/344] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:47 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:47.474713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99711c90-68a9-4464-ba74-ecaaaa5705b4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:47.513545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2b7ea-2aa8-437c-8bb6-d1719a0f6ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:47.514502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b7ea-2aa8-437c-8bb6-d1719a0f6ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.514936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b7ea-2aa8-437c-8bb6-d1719a0f6ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.515649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b7ea-2aa8-437c-8bb6-d1719a0f6ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.517249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2b7ea-2aa8-437c-8bb6-d1719a0f6ba2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:47.518043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2b7ea-2aa8-437c-8bb6-d1719a0f6ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:47.521289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2b7ea-2aa8-437c-8bb6-d1719a0f6ba2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:47.535208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 179/345] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:47 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:47.537952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39ea9-1fa8-4822-a831-36b5ee4d4c53 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.538435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39ea9-1fa8-4822-a831-36b5ee4d4c53 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.538950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39ea9-1fa8-4822-a831-36b5ee4d4c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.563434 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-15b39ea9-1fa8-4822-a831-36b5ee4d4c53 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:47.565561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-15b39ea9-1fa8-4822-a831-36b5ee4d4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:47.624136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99711c90-68a9-4464-ba74-ecaaaa5705b4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:47.662315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 180/346] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:47.663233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39ea9-1fa8-4822-a831-36b5ee4d4c53 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:47.683414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:47.684095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.684352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.684627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.713435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:47.781227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:47.783984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:47.818333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:47.822717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39ea9-1fa8-4822-a831-36b5ee4d4c53 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:47.872579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:47.873249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:47.873543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:47.873875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:47.900635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:47.906440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:47.907338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:47.908701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 181/347] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:47.909385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:47.921125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 167/348] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:47.922883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:47.981966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.041535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cba625-507b-4fc0-888f-80daaab96df0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.047844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0507-2a7e-4778-b177-45ca096acad6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.081046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.081975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.082510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.083046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.087546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.087925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.088208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.088529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.100083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:48.105686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:48.106604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:48.107387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 168/349] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:48.108031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.119343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.163862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:48.165723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:48.228768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cde6c-7642-4f5c-8b65-5bc86e604eda None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.231418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.270378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.271487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.271770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.272109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.272837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:48.273147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:48.278383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:48.278690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 182/350] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:48.279805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.284019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 169/351] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:48.284919 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.344980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.388919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c4ab5-4ee0-4feb-ba44-78fa82d0f1e2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.399779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c3e9e-4864-4340-b40f-ae2c884785e9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.425841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.427525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.428026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.428527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.430178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:48.431886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:48.433819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 183/352] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:48.434890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.441653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.442840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.443126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.443401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.444187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:48.444501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:48.445864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:48.456906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 170/353] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:48.457792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.495694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.559482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cd8a1-7508-4e0d-b797-826492bb0702 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.594505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.597640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393b97-2b93-4481-9e80-2ac2bea02b3d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.607567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.608475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.608938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.609426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.646942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7ba77-6623-4e55-bc47-379fbf930a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.649617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ba77-6623-4e55-bc47-379fbf930a4c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.649617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ba77-6623-4e55-bc47-379fbf930a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.649963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ba77-6623-4e55-bc47-379fbf930a4c None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.651153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7ba77-6623-4e55-bc47-379fbf930a4c None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:48.654579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7ba77-6623-4e55-bc47-379fbf930a4c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:48.656446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 171/354] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:48.657432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60d62a-3769-4b38-b940-5c993f3d11e0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.657715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60d62a-3769-4b38-b940-5c993f3d11e0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.658000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60d62a-3769-4b38-b940-5c993f3d11e0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.661367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 172/355] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:48.662777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60d62a-3769-4b38-b940-5c993f3d11e0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.706409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:48.707949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:48.777505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.787077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60d62a-3769-4b38-b940-5c993f3d11e0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.829186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.829912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.830192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.830407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 184/356] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:48.830523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.831513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.838446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:48.839938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:48.841789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 173/357] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:48.842407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:48.862156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:48.952597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6c93-0c6e-40b9-a96a-91958f7a875c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.967530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7719c-c3a4-464f-ac43-9e42af6b3e41 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:48.996597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac003e-4fd8-4ad5-97f6-e4e87c41c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:48.997250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac003e-4fd8-4ad5-97f6-e4e87c41c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:48.997540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac003e-4fd8-4ad5-97f6-e4e87c41c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:48.997825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac003e-4fd8-4ad5-97f6-e4e87c41c7d1 None admin] PATH_INFO: `/v3/users/f5e3426c504d4171a68b2a05530f86c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:48.999062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac003e-4fd8-4ad5-97f6-e4e87c41c7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f5e3426c504d4171a68b2a05530f86c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.000530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac003e-4fd8-4ad5-97f6-e4e87c41c7d1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.002177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 185/358] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/users/f5e3426c504d4171a68b2a05530f86c5 => generated 294 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.004488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad180f-b1c5-45e9-95c8-25a9bfa2cecc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.004816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad180f-b1c5-45e9-95c8-25a9bfa2cecc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.005099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad180f-b1c5-45e9-95c8-25a9bfa2cecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.006181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebfe8c-fb1a-42c5-8d75-58d3049ace1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.006879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfe8c-fb1a-42c5-8d75-58d3049ace1b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.007238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfe8c-fb1a-42c5-8d75-58d3049ace1b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.007511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebfe8c-fb1a-42c5-8d75-58d3049ace1b None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.008702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebfe8c-fb1a-42c5-8d75-58d3049ace1b None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.010323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebfe8c-fb1a-42c5-8d75-58d3049ace1b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.011993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 174/359] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:48 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.013463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fd69b-be6d-4fcc-89e8-c91bcb0459f0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.013744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fd69b-be6d-4fcc-89e8-c91bcb0459f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.014015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fd69b-be6d-4fcc-89e8-c91bcb0459f0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.015573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 175/360] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:49.016290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fd69b-be6d-4fcc-89e8-c91bcb0459f0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.032205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a4ad180f-b1c5-45e9-95c8-25a9bfa2cecc None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:49.033177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a4ad180f-b1c5-45e9-95c8-25a9bfa2cecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:49.050895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:49.118637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 186/361] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:49.119499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad180f-b1c5-45e9-95c8-25a9bfa2cecc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.142614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fd69b-be6d-4fcc-89e8-c91bcb0459f0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.149851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:49.183132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.183788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.184069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.184369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.185797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.187066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.188893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 176/362] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.189658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.241357 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad180f-b1c5-45e9-95c8-25a9bfa2cecc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.287619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.288262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.288701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.288980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.289785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:49.290099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.291630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.296025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:49.297459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 187/363] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 261 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.298487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.309448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c746d12-7e9f-45e2-8309-fe942114dace None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.363515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfbfad-304e-4675-88f2-f7b95e438a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.364721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbfad-304e-4675-88f2-f7b95e438a10 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.365039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbfad-304e-4675-88f2-f7b95e438a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.365291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbfad-304e-4675-88f2-f7b95e438a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.366111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfbfad-304e-4675-88f2-f7b95e438a10 None admin] RBAC: Adding query filter params (role.id=c7886317cc6442cf921bd42a66462c1b, user.id=f5e3426c504d4171a68b2a05530f86c5, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:49.366512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfbfad-304e-4675-88f2-f7b95e438a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.368081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfbfad-304e-4675-88f2-f7b95e438a10 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.389875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 177/364] 10.222.0.121 () {56 vars in 1313 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/role_assignments?user.id=f5e3426c504d4171a68b2a05530f86c5&scope.system=all&role.id=c7886317cc6442cf921bd42a66462c1b => generated 512 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.391236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44067f2c-c48d-45d6-b87a-9278c214071c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.391529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44067f2c-c48d-45d6-b87a-9278c214071c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.391811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44067f2c-c48d-45d6-b87a-9278c214071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.419086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-44067f2c-c48d-45d6-b87a-9278c214071c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:49.420896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-44067f2c-c48d-45d6-b87a-9278c214071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:49.440203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:49.455105 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbdfd-1151-42dd-bc3d-de112315c527 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.499908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.500885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.501171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.501446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.502608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:49.503406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.506042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.514029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 178/365] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:49.514944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 188/366] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 261 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.515058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44067f2c-c48d-45d6-b87a-9278c214071c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.515895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.678910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:49.697737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44067f2c-c48d-45d6-b87a-9278c214071c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.707293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463ed1-9ac8-406e-a571-761d7ed5b523 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.736188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.736845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.737130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.737416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.747056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.747722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.748001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.748276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.749447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.750922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.751359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:49.752529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 189/367] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.753289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:49.757435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:49.758350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:49.760653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 179/368] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:49.766302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.784039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:49.869518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a1e3-0701-462b-a97c-4ba4f63b7c21 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.873507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9641-bb2e-420d-8e16-f55ec1619fdc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:49.910620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.911479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:49.911861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.912079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:49.912178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.912359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:49.912463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.912635 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:49.913428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:49.913735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:49.915280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:49.921751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 180/369] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 261 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:49.922676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:49.924911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:49.932256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:49.933192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:49.933973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 190/370] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:49.937968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:49.943364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.042219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7e3ff-7ada-43c1-ad43-d8af2daaf2f9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.076611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:50.079769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.082690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.082690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.082690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.082690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:50.082690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.084901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.094518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 181/371] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:50.100863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.101573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a691e-9c48-4a6c-a006-fec46740624b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.141600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.142248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.142561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.142836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.143571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:50.143875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.146213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.156052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 191/372] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:50.162141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.190707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:50.226659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824062-b0ac-470e-9bf3-3fa6f9854346 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.263606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.264241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.264524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.264801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.273469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaa1d3-2ed4-41eb-9527-9805e9f5d49a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.310161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.310868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.311155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.311432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.327047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:50.357843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.359695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.386014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.387567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.497717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 192/373] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:49:50.497889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:50.507299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.532835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 182/374] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 16:49:50.538871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.569342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:50.636274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72012109-0c24-49c4-9e5f-096d87e0f86e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.645299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c909f67-ff02-4ecc-bd72-3f101e26874b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.673951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.674644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.674927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.675195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] PATH_INFO: `/v3/projects/af3932992b7744cba48da1d3cbe4b99c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.676367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] RBAC: Authorizing `identity:get_project(project_id=af3932992b7744cba48da1d3cbe4b99c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.678446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.680246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 193/375] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/projects/af3932992b7744cba48da1d3cbe4b99c => generated 345 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:50.683802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.684464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.684744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.685020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.686239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.686366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.687829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.689821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 183/376] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:50.695276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.741002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:50.802681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21947d8-a765-4a13-a5d9-9e82221cbfd8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.813455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f36c76-236a-42fa-8888-177a07730208 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:50.818824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:50.845743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.846696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.847119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.847532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] PATH_INFO: `/v3/groups/46080dcc3bfb4524972ed871600a8598` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.856098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] RBAC: Authorizing `identity:get_group(group_id=46080dcc3bfb4524972ed871600a8598)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.858130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.860869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 194/377] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/groups/46080dcc3bfb4524972ed871600a8598 => generated 230 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:50.861682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:50.866414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:50.866715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:50.866999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:50.869518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:50.870208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:50.871035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:50.872791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 184/378] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:50.884364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:51.006618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86df88-804a-472a-9cfb-f450d4199d68 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:51.012583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73e578-d944-4607-8e97-e24b7cd2d154 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:51.023811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:51.049840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edef82-7751-422b-be98-6b3d421e329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:51.050526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edef82-7751-422b-be98-6b3d421e329b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:51.050809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edef82-7751-422b-be98-6b3d421e329b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:51.051085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edef82-7751-422b-be98-6b3d421e329b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:51.052393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edef82-7751-422b-be98-6b3d421e329b None admin] RBAC: Adding query filter params (group.id=46080dcc3bfb4524972ed871600a8598, role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=af3932992b7744cba48da1d3cbe4b99c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:51.052762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edef82-7751-422b-be98-6b3d421e329b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:51.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edef82-7751-422b-be98-6b3d421e329b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:51.059525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3503d1b-afc8-4791-8a17-ba238550f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:51.060168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503d1b-afc8-4791-8a17-ba238550f43c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:51.060449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503d1b-afc8-4791-8a17-ba238550f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:51.060725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503d1b-afc8-4791-8a17-ba238550f43c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:51.060990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 195/379] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/role_assignments?group.id=46080dcc3bfb4524972ed871600a8598&scope.project.id=af3932992b7744cba48da1d3cbe4b99c&role.id=0b911707f2884d61bd847b72d704811f => generated 261 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:51.061520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3503d1b-afc8-4791-8a17-ba238550f43c None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:51.061831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3503d1b-afc8-4791-8a17-ba238550f43c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:51.063317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3503d1b-afc8-4791-8a17-ba238550f43c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:51.070568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 185/380] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:50 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 261 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:51.774503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3ffc-6704-4506-9993-d2452dcc0d26 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:51.774890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3ffc-6704-4506-9993-d2452dcc0d26 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:51.775214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3ffc-6704-4506-9993-d2452dcc0d26 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:51.776712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 196/381] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:51.782192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7876f-fa03-400b-b1d5-fd00b7f4a194 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:51.782631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7876f-fa03-400b-b1d5-fd00b7f4a194 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:51.782906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7876f-fa03-400b-b1d5-fd00b7f4a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:51.802027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5cb7876f-fa03-400b-b1d5-fd00b7f4a194 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:51.807373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5cb7876f-fa03-400b-b1d5-fd00b7f4a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:51.892964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 186/382] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:51.926392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f3ffc-6704-4506-9993-d2452dcc0d26 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:51.985228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:52.057835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f3ffc-6704-4506-9993-d2452dcc0d26 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:52.099259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:52.099912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:52.100197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:52.100472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:52.123257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:52.128757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:52.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:52.131184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:52.131791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 197/383] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:52.139466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7876f-fa03-400b-b1d5-fd00b7f4a194 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:52.268865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:52.273225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7876f-fa03-400b-b1d5-fd00b7f4a194 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:52.318514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bdc49-aaf5-4a5d-b54a-3eb114181e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:52.319080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdc49-aaf5-4a5d-b54a-3eb114181e69 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:52.319362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdc49-aaf5-4a5d-b54a-3eb114181e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:52.319639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bdc49-aaf5-4a5d-b54a-3eb114181e69 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:52.320363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bdc49-aaf5-4a5d-b54a-3eb114181e69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:52.320671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bdc49-aaf5-4a5d-b54a-3eb114181e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:52.322046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bdc49-aaf5-4a5d-b54a-3eb114181e69 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:52.331224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 187/384] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:52.339233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:52.425783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd362-8756-44f6-9228-10ed5a208794 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:52.426207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd362-8756-44f6-9228-10ed5a208794 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:52.426894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfd362-8756-44f6-9228-10ed5a208794 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:52.428306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 188/385] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:52 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:52.436164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62520ff2-f59b-4854-8f71-4a790b931627 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:52.436452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62520ff2-f59b-4854-8f71-4a790b931627 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:52.436733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62520ff2-f59b-4854-8f71-4a790b931627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:52.464531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-62520ff2-f59b-4854-8f71-4a790b931627 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:52.465742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-62520ff2-f59b-4854-8f71-4a790b931627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:52.521417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:52.525580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd257ae-3ec1-474e-a8e3-54808796614a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:52.586439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 189/386] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:52.596995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:52.597689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:52.597992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:52.598438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:52.599716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:52.601178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:52.602826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 198/387] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:52 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:52.608395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62520ff2-f59b-4854-8f71-4a790b931627 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:52.617539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:52.762648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:52.765300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa364-0662-436b-a3ae-04d3027f456f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:52.782378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62520ff2-f59b-4854-8f71-4a790b931627 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:52.839478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:52.840055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:52.840333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:52.840603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:52.858609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:52.859271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:52.859551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:52.859822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:52.861216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:52.862687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:52.865568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:52.871097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:52.871952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:52.872735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:52.873344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 190/388] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:52 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:52.873412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:52.874030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 199/389] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:52.886884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:52.924839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:53.015518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10f84f-5b1c-41f9-9c41-4391960bd1ca None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:53.024354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906d7d5-7204-49b7-bd5c-232d15a501a6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:53.060932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9b688-d593-4bae-b772-8a5797c2f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:53.061699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b688-d593-4bae-b772-8a5797c2f074 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.062081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b688-d593-4bae-b772-8a5797c2f074 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.062478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b688-d593-4bae-b772-8a5797c2f074 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.063293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9b688-d593-4bae-b772-8a5797c2f074 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:53.063695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9b688-d593-4bae-b772-8a5797c2f074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:53.065182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9b688-d593-4bae-b772-8a5797c2f074 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:53.069973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebd08b-99bc-4986-8e42-7b3f652a4db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:53.070684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebd08b-99bc-4986-8e42-7b3f652a4db9 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.070970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebd08b-99bc-4986-8e42-7b3f652a4db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.071249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebd08b-99bc-4986-8e42-7b3f652a4db9 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.074323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebd08b-99bc-4986-8e42-7b3f652a4db9 None admin] RBAC: Authorizing `identity:create_grant(project_id=335cb7bfb0d4444487deea2e3fd3b433, group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:53.075904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebd08b-99bc-4986-8e42-7b3f652a4db9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:53.076611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 200/390] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:53.077986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238c14-0908-45f4-9125-b22e1639aa5a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.078455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238c14-0908-45f4-9125-b22e1639aa5a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.078833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238c14-0908-45f4-9125-b22e1639aa5a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.080400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 201/391] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:53.087281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19238c14-0908-45f4-9125-b22e1639aa5a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:53.099236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 191/392] 10.222.0.121 () {58 vars in 1447 bytes} [Mon Aug 1 16:49:52 2022] PUT /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/0db42c55aa904f95983cff92ac10ac3b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:53.100633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e477f-c572-4e7f-9ed3-0240ebff1aa4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.100933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e477f-c572-4e7f-9ed3-0240ebff1aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.101216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e477f-c572-4e7f-9ed3-0240ebff1aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.127681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-097e477f-c572-4e7f-9ed3-0240ebff1aa4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:53.129308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-097e477f-c572-4e7f-9ed3-0240ebff1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:53.168451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:53.273316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 192/393] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:53.279343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:53.290194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19238c14-0908-45f4-9125-b22e1639aa5a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:53.300214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e477f-c572-4e7f-9ed3-0240ebff1aa4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:53.328656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:53.329316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.329851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.330403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.332142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:53.333934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:53.336382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 202/394] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:53 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:53.344461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:53.475982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe1971-2b6a-4071-afac-2c6fb799ca6b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:53.496521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e477f-c572-4e7f-9ed3-0240ebff1aa4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:53.518872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:53.519798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.520785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.521218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.522613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:53.525006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:53.527219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 203/395] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:53 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:53.532742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:53.565286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:53.594989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:53.595969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.595969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.596175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.631987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:53.637063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:53.638498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:53.639626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:53.646777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 193/396] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:53.655995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d99ec2-c14c-4e26-b557-9a85b27e39d9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:53.659270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:53.684320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:53.695905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be32c5-8c2a-46d8-8f17-04244f0981ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:53.696958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be32c5-8c2a-46d8-8f17-04244f0981ca None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.697395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be32c5-8c2a-46d8-8f17-04244f0981ca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.697826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be32c5-8c2a-46d8-8f17-04244f0981ca None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.700072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be32c5-8c2a-46d8-8f17-04244f0981ca None admin] RBAC: Authorizing `identity:create_grant(project_id=335cb7bfb0d4444487deea2e3fd3b433, group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:53.701888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be32c5-8c2a-46d8-8f17-04244f0981ca None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:53.717407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 204/397] 10.222.0.121 () {58 vars in 1447 bytes} [Mon Aug 1 16:49:53 2022] PUT /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:53.767290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e661f6d-d31f-407c-bba0-5440ce69c98f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.767641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e661f6d-d31f-407c-bba0-5440ce69c98f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.768024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e661f6d-d31f-407c-bba0-5440ce69c98f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.769841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 205/398] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:53.775880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038cafe-88a2-4189-b23c-0b328a99714a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.776239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038cafe-88a2-4189-b23c-0b328a99714a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.776595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038cafe-88a2-4189-b23c-0b328a99714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.799189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6038cafe-88a2-4189-b23c-0b328a99714a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:53.800856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6038cafe-88a2-4189-b23c-0b328a99714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:53.820471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2633-7b87-40a8-b246-8fcfa045a7b1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:53.862530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891158-4795-414e-a26b-dc3d0386d883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:53.863692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891158-4795-414e-a26b-dc3d0386d883 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.864767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891158-4795-414e-a26b-dc3d0386d883 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.865219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891158-4795-414e-a26b-dc3d0386d883 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.866204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891158-4795-414e-a26b-dc3d0386d883 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:53.866880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891158-4795-414e-a26b-dc3d0386d883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:53.868504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891158-4795-414e-a26b-dc3d0386d883 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:53.878951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 194/399] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:53 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:53.885110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a9c0-cca6-4cb0-a568-28a61362a0ee None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.886023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a9c0-cca6-4cb0-a568-28a61362a0ee None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.886530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a9c0-cca6-4cb0-a568-28a61362a0ee None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.888758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 195/400] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:53 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:53.890185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a9c0-cca6-4cb0-a568-28a61362a0ee None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:53.890455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 206/401] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:53.899792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586b7d-25ee-4160-a226-9829a50dd65a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:53.900083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586b7d-25ee-4160-a226-9829a50dd65a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:53.900363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586b7d-25ee-4160-a226-9829a50dd65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:53.931657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-53586b7d-25ee-4160-a226-9829a50dd65a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:53.932853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-53586b7d-25ee-4160-a226-9829a50dd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:53.948088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:53.991237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:54.032823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 207/402] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:54.033854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586b7d-25ee-4160-a226-9829a50dd65a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.034546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a9c0-cca6-4cb0-a568-28a61362a0ee None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.073798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.074822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.075283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.075767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.077143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:54.078883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:54.081032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 196/403] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:53 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:54.086293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.171890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586b7d-25ee-4160-a226-9829a50dd65a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.193844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564c37b-534f-4152-a6df-626b2d199c9b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.211231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.211970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.212257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.212538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.224429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:54.230028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:54.230988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:54.231833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:54.236392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 208/404] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:54.237093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.237217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.238131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.238880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.239457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.248484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:54.251020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:54.256405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:54.262096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:54.263583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:54.264373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:54.267138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 197/405] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:54.268226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.356275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd6b2-bfe7-4f28-b413-4d7c731edaa5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.394677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.395448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.395729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.396006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.397185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:54.398683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:54.400525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 209/406] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:54.401120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.423157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683c95d-9de1-4b1f-8495-869389f3f54a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.470150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.471386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.471689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.471976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.472964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:54.473814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:54.475478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:54.491292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 198/407] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:54.492337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.492618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:54.528709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c31ae1-8e58-404c-aa0c-a84c2f4406e3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.566290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.567097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:54.567219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.567611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.568270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.569150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:54.569550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:54.571241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:54.581606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 210/408] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:54.582932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.617941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c719240-5cf7-440c-8a5d-1b047b622943 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.654570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.655887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.656178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.656457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.659045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] RBAC: Authorizing `identity:create_grant(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc, group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:54.661449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:54.681810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 199/409] 10.222.0.121 () {58 vars in 1447 bytes} [Mon Aug 1 16:49:54 2022] PUT /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:54.682994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.707369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452ab0b-b2a2-4a39-ad7c-64e69ddad4f0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.749054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.750220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.750757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.751250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.752736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:54.755156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:54.757769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 211/410] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:54.766135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.778782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:54.850623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d806-3d80-4499-a82a-68c031d50572 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.888546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:54.909977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:54.910751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:54.911601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:54.911884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] PATH_INFO: `/v3/groups/46080dcc3bfb4524972ed871600a8598` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:54.913099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] RBAC: Authorizing `identity:get_group(group_id=46080dcc3bfb4524972ed871600a8598)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:54.914582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:54.916516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 200/411] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/groups/46080dcc3bfb4524972ed871600a8598 => generated 230 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:54.921453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:54.947410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14dd7e-7634-4a65-8cc7-365d13b04311 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:54.998982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:55.001097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:55.002724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:55.003137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:55.006533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:55.007997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:55.009962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 212/412] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:55.016259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:55.071996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38000b-0b0c-4ac4-a2cd-ef071098edff None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:55.108352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:55.108970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:55.109256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:55.109575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] PATH_INFO: `/v3/projects/af3932992b7744cba48da1d3cbe4b99c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:55.110786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] RBAC: Authorizing `identity:get_project(project_id=af3932992b7744cba48da1d3cbe4b99c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:55.112400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:55.115200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 201/413] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:54 2022] GET /identity/v3/projects/af3932992b7744cba48da1d3cbe4b99c => generated 345 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:55.127289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:55.145791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:55.180814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dd53c-d36c-4fbc-96b5-0fc488a9cb76 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:55.204981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:55.231635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba008abe-c9fb-48f0-bffb-6a0008685d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:55.232689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008abe-c9fb-48f0-bffb-6a0008685d66 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:55.233213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008abe-c9fb-48f0-bffb-6a0008685d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:55.233712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba008abe-c9fb-48f0-bffb-6a0008685d66 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:55.240721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008abe-c9fb-48f0-bffb-6a0008685d66 None admin] RBAC: Authorizing `identity:create_grant(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc, group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:55.242448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba008abe-c9fb-48f0-bffb-6a0008685d66 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:55.251911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701975-2d96-4b69-bb2d-44a12cc8942f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:55.276528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 213/414] 10.222.0.121 () {58 vars in 1447 bytes} [Mon Aug 1 16:49:55 2022] PUT /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6/roles/0db42c55aa904f95983cff92ac10ac3b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:55.289588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7a539-ca52-4b30-bc01-c628fef43b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:55.290320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a539-ca52-4b30-bc01-c628fef43b65 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:55.290608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a539-ca52-4b30-bc01-c628fef43b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:55.290894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7a539-ca52-4b30-bc01-c628fef43b65 None admin] PATH_INFO: `/v3/projects/af3932992b7744cba48da1d3cbe4b99c/groups/46080dcc3bfb4524972ed871600a8598/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:55.293260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7a539-ca52-4b30-bc01-c628fef43b65 None admin] RBAC: Authorizing `identity:create_grant(project_id=af3932992b7744cba48da1d3cbe4b99c, group_id=46080dcc3bfb4524972ed871600a8598, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:55.294808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7a539-ca52-4b30-bc01-c628fef43b65 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:55.329959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 202/415] 10.222.0.121 () {58 vars in 1447 bytes} [Mon Aug 1 16:49:55 2022] PUT /identity/v3/projects/af3932992b7744cba48da1d3cbe4b99c/groups/46080dcc3bfb4524972ed871600a8598/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:49:55.448663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8e796-aeb8-4699-96c8-1722c7f1b6b8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:55.449295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8e796-aeb8-4699-96c8-1722c7f1b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:55.449778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8e796-aeb8-4699-96c8-1722c7f1b6b8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:55.451453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 214/416] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:55.458146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b27c7-0c49-46e1-ac39-cabe7fb0ad77 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:55.458470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b27c7-0c49-46e1-ac39-cabe7fb0ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:55.458753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b27c7-0c49-46e1-ac39-cabe7fb0ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:55.480995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-858b27c7-0c49-46e1-ac39-cabe7fb0ad77 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:55.482352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-858b27c7-0c49-46e1-ac39-cabe7fb0ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:55.562343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 203/417] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:55.587057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8e796-aeb8-4699-96c8-1722c7f1b6b8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:55.733797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8e796-aeb8-4699-96c8-1722c7f1b6b8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:55.775985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:55.782418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:55.783072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:55.783353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:55.783625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:55.803234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:55.808223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:55.809081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:55.810285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 215/418] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:55.815331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b27c7-0c49-46e1-ac39-cabe7fb0ad77 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:55.900191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:55.969637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b27c7-0c49-46e1-ac39-cabe7fb0ad77 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:56.024999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f6334-140f-493a-a51f-b92aca2ab23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:56.025624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f6334-140f-493a-a51f-b92aca2ab23d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.025903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f6334-140f-493a-a51f-b92aca2ab23d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.026179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f6334-140f-493a-a51f-b92aca2ab23d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:56.026944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f6334-140f-493a-a51f-b92aca2ab23d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:56.027242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f6334-140f-493a-a51f-b92aca2ab23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:56.028622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f6334-140f-493a-a51f-b92aca2ab23d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:56.042228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 204/419] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:55 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:56.047407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:56.191089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd09c8-175f-44c2-be3d-c18611b97812 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:56.233063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85224a-7527-4016-9b5f-b5bcbab0bf95 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.233593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85224a-7527-4016-9b5f-b5bcbab0bf95 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.233826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85224a-7527-4016-9b5f-b5bcbab0bf95 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:56.235107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 205/420] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:49:56.239851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:56.240477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.240597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43de2c-3126-4909-bdb4-72e70e859501 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.240763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.240869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43de2c-3126-4909-bdb4-72e70e859501 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.241022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:56.241117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43de2c-3126-4909-bdb4-72e70e859501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:56.260328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5d43de2c-3126-4909-bdb4-72e70e859501 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:56.261797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5d43de2c-3126-4909-bdb4-72e70e859501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:56.326479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:56.334999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 206/421] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:56.347476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:56.349012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:56.381541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43de2c-3126-4909-bdb4-72e70e859501 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:56.472327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 216/422] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:56.476540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:56.478560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:56.549084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43de2c-3126-4909-bdb4-72e70e859501 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:56.584268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:56.584903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.585191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.585464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:56.596265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:56.602062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:56.602991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:56.604219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 207/423] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:49:56.609352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:56.707784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:56.715470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:56.719775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df451b2-c31d-4020-815f-64f8d8426a38 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:56.726367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94d1ff-4cff-424e-8ffe-ab895522b5c1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:56.782243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:56.782916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.783199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.783475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:56.784227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:56.784535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:56.786532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:56.792335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:56.793001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.793285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.793560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:56.794763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:56.795816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 208/424] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:56 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:56.798930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:56.801079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 217/425] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:56 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:56.807289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:56.808591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:56.950054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b513a3-d64d-4991-9f54-102f59dc5115 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:56.986109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e00d7-9b33-4f52-8650-6b83086c1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:56.986876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e00d7-9b33-4f52-8650-6b83086c1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:56.987163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e00d7-9b33-4f52-8650-6b83086c1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:56.987440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e00d7-9b33-4f52-8650-6b83086c1dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.019643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:57.024174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd658b4-3c66-477d-956c-f7e19eb097d0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.061078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e00d7-9b33-4f52-8650-6b83086c1dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:57.063974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e00d7-9b33-4f52-8650-6b83086c1dd5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:57.134368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb81a92-5736-4cd4-8a59-a66818821774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.135021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81a92-5736-4cd4-8a59-a66818821774 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.135370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81a92-5736-4cd4-8a59-a66818821774 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.135653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81a92-5736-4cd4-8a59-a66818821774 None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.136925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb81a92-5736-4cd4-8a59-a66818821774 None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:57.138614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb81a92-5736-4cd4-8a59-a66818821774 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:57.140352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 218/426] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:56 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:57.141334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3da1-8585-483b-a3bd-ac497bac8779 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.141753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3da1-8585-483b-a3bd-ac497bac8779 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.141926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd3da1-8585-483b-a3bd-ac497bac8779 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.143118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 219/427] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:57 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:57.148962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd3da1-8585-483b-a3bd-ac497bac8779 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:57.180464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:57.204093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 209/428] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:57.209965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0cf2b-b36c-4788-b29f-3a7d919c0337 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.210289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0cf2b-b36c-4788-b29f-3a7d919c0337 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.210566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0cf2b-b36c-4788-b29f-3a7d919c0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.230154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1ea0cf2b-b36c-4788-b29f-3a7d919c0337 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:57.231429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ea0cf2b-b36c-4788-b29f-3a7d919c0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:57.260660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd3da1-8585-483b-a3bd-ac497bac8779 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.293410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:57.303482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.304166 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.304453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.304819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.305622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:57.305935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:57.307470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:57.313494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 210/429] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:57.313494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0cf2b-b36c-4788-b29f-3a7d919c0337 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:57.320136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 220/430] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:57 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 613 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:57.355906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:57.464633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0cf2b-b36c-4788-b29f-3a7d919c0337 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.508741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.510825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.511111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.511392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] PATH_INFO: `/v3/projects/335cb7bfb0d4444487deea2e3fd3b433` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.513101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] RBAC: Authorizing `identity:get_project(project_id=335cb7bfb0d4444487deea2e3fd3b433)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:57.515529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:57.519271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 211/431] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:57 2022] GET /identity/v3/projects/335cb7bfb0d4444487deea2e3fd3b433 => generated 299 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:57.526381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:57.548132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:57.565099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b78ec-f526-473a-9c3d-b75ccbeea5f3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.605696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.606848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.607458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:57.608528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.609063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.622061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:57.628023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:57.628903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 16:49:57.629737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:57.634381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 221/432] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:57.638756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:57.657447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4685d89-89dc-4582-9434-6f3369b31edf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.698866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.699701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.699987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.700266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.701592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:57.703072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:57.705184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 212/433] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:57 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:57.711563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:57.751262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62184-2923-4015-8746-fc5ce49ee87f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.796631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923f5c0-1e9d-4ab6-b8fc-1719d295eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.797374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f5c0-1e9d-4ab6-b8fc-1719d295eba1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.797665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f5c0-1e9d-4ab6-b8fc-1719d295eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.797944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923f5c0-1e9d-4ab6-b8fc-1719d295eba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.798725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923f5c0-1e9d-4ab6-b8fc-1719d295eba1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:57.799033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923f5c0-1e9d-4ab6-b8fc-1719d295eba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:57.800428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923f5c0-1e9d-4ab6-b8fc-1719d295eba1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:57.813509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 222/434] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:49:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:57.813509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d42e-4c2b-4d0b-af9a-509cecbf907b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.813509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d42e-4c2b-4d0b-af9a-509cecbf907b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.813509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d42e-4c2b-4d0b-af9a-509cecbf907b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.813509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 223/435] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:57.817342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d42e-4c2b-4d0b-af9a-509cecbf907b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:57.834410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:57.838959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020da3c-5437-4354-8a45-5a251ed0bdef None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.867676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:57.877403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e225b0-4245-46ca-a785-c7023ad613b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.878027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e225b0-4245-46ca-a785-c7023ad613b8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.878339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e225b0-4245-46ca-a785-c7023ad613b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.878616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e225b0-4245-46ca-a785-c7023ad613b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.879441 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e225b0-4245-46ca-a785-c7023ad613b8 None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=335cb7bfb0d4444487deea2e3fd3b433) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:57.879751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e225b0-4245-46ca-a785-c7023ad613b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:57.883957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e225b0-4245-46ca-a785-c7023ad613b8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:57.888727 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 213/436] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:57 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=335cb7bfb0d4444487deea2e3fd3b433&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 613 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:57.889923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4867-6847-46ad-80f3-49ac418c2229 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.890214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4867-6847-46ad-80f3-49ac418c2229 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.890524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4867-6847-46ad-80f3-49ac418c2229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.910065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ba6b4867-6847-46ad-80f3-49ac418c2229 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:57.911896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ba6b4867-6847-46ad-80f3-49ac418c2229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:57.933641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d42e-4c2b-4d0b-af9a-509cecbf907b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:57.972073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:57.972712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.973000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.973827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.992002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 214/437] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:49:57.993311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9295-08d1-4665-843d-2f8f314a504b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:57.993665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9295-08d1-4665-843d-2f8f314a504b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:57.993947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9295-08d1-4665-843d-2f8f314a504b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:57.995487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 215/438] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:49:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:49:58.004823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbb115-87e2-4d45-b03c-ed47a4013ba8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.005124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbb115-87e2-4d45-b03c-ed47a4013ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.005306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbb115-87e2-4d45-b03c-ed47a4013ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.026493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5ffbb115-87e2-4d45-b03c-ed47a4013ba8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:49:58.027734 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ffbb115-87e2-4d45-b03c-ed47a4013ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:49:58.069713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:58.071218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:58.086955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.107418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 216/439] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:49:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:49:58.111348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbb115-87e2-4d45-b03c-ed47a4013ba8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.171897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.193772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 224/440] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:58.195006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.230890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbb115-87e2-4d45-b03c-ed47a4013ba8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.273397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.274368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.274825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.275099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.287150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:58.292297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:58.293192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 217/441] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:58.294461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.317409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5c5d4-55dd-4eb5-8c41-43bd9340ef48 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.333713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.360264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.360913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.361195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.361468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.373586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:49:58.378640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:49:58.379568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 225/442] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:49:58.383536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.420267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646723b9-3c80-4129-be00-145b26de66a9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.435571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.458082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.458757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.459043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.459317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.460471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:58.461905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:58.467924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 218/443] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:58.467924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.499906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60732ce9-c407-45d3-84dd-8345f2039f05 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.533634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.534185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.534498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.534776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.535495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:58.535794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:58.537165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:58.544882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 226/444] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:58.545654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.565058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94049ae-c2ef-4216-9da9-2765e2775bdd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.579759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.599360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.600080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.600368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.600648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.601398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:58.601707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:58.603102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:58.610978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 219/445] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:58.611761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.645031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5261e-ca1b-42e7-a7ff-631e0864c3c4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.655805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.678926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.679576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.679864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.680143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.681309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:58.682799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:58.684400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 227/446] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:58.685157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.712127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437aee37-99ea-41a4-95b7-14f118423873 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.745715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.746368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.746654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.746932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.784452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1222972-0160-4216-b00f-36e8c2ca8be2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:58.786685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.813303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:58.814800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:58.818731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:58.819352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:58.819697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:58.819975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:58.855658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:58.887116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:58.888911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:58.914309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 220/447] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:58.915162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.991640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 228/448] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:58.992480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:58.996699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:59.012471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6271-f258-4faa-82d3-41f2290d643d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:59.046435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:59.047136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:59.047420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:59.047698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:59.048481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=75e3e827b8d74897a0500ac1c262a078, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:59.048790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:59.050224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:59.055863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 221/449] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=75e3e827b8d74897a0500ac1c262a078 => generated 613 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:59.056640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:59.065557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:59.110141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73257b7a-e3a7-43a8-a8f8-6149e84b65de None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:59.150749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:59.151513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:59.152014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:59.152305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] PATH_INFO: `/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:59.154095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] RBAC: Authorizing `identity:get_project(project_id=69eeffa17e3e4e4e91f1edfb5d4782dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:59.155618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:59.158092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 229/450] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:58 2022] GET /identity/v3/projects/69eeffa17e3e4e4e91f1edfb5d4782dc => generated 303 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:59.164548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:59.184695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc05a-aa1a-4a76-94c9-4e66df2fc8bc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:59.225970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:59.226656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:59.226941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:59.229217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] PATH_INFO: `/v3/projects/af3932992b7744cba48da1d3cbe4b99c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:59.229861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] RBAC: Authorizing `identity:get_project(project_id=af3932992b7744cba48da1d3cbe4b99c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:59.231472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:59.233849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 222/451] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:49:59 2022] GET /identity/v3/projects/af3932992b7744cba48da1d3cbe4b99c => generated 345 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:59.238566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:59.251331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:59.294016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cd69d-b0ca-4d87-8b8e-bcf97ae85666 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:59.326422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:59.334558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:59.335219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:59.335501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:59.335774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] PATH_INFO: `/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:59.337804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] RBAC: Authorizing `identity:get_group(group_id=6808dbe89f1649dc80fd5a2e2ac0f5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:59.339367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:59.341016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 230/452] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:59 2022] GET /identity/v3/groups/6808dbe89f1649dc80fd5a2e2ac0f5c6 => generated 227 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:59.346834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:59.361215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38b57-8331-4e15-943a-99bb76ecce9e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:59.401111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:59.401783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:59.402073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:59.402527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] PATH_INFO: `/v3/groups/46080dcc3bfb4524972ed871600a8598` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:59.403724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] RBAC: Authorizing `identity:get_group(group_id=46080dcc3bfb4524972ed871600a8598)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:59.405176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:59.407105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 223/453] 10.222.0.121 () {56 vars in 1185 bytes} [Mon Aug 1 16:49:59 2022] GET /identity/v3/groups/46080dcc3bfb4524972ed871600a8598 => generated 230 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:49:59.414152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:49:59.465980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d59d71-37c9-49d2-a6c2-a2c5e38d99b6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:59.502047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac24ed-0144-41a1-bf81-6d810559f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:59.502697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac24ed-0144-41a1-bf81-6d810559f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:59.502982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac24ed-0144-41a1-bf81-6d810559f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:59.503255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac24ed-0144-41a1-bf81-6d810559f8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:59.504040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac24ed-0144-41a1-bf81-6d810559f8b0 None admin] RBAC: Adding query filter params (group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6, role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:59.504382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac24ed-0144-41a1-bf81-6d810559f8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:59.505804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac24ed-0144-41a1-bf81-6d810559f8b0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:59.511528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 231/454] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:59 2022] GET /identity/v3/role_assignments?group.id=6808dbe89f1649dc80fd5a2e2ac0f5c6&scope.project.id=69eeffa17e3e4e4e91f1edfb5d4782dc&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 613 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:49:59.513828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e1e9c-67c9-47c5-ae35-3a22061b4b7b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:49:59.549516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78c273-f439-4949-ae81-b3ab5297caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:49:59.550148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c273-f439-4949-ae81-b3ab5297caa1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:49:59.550507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c273-f439-4949-ae81-b3ab5297caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:49:59.550868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c273-f439-4949-ae81-b3ab5297caa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:49:59.552218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78c273-f439-4949-ae81-b3ab5297caa1 None admin] RBAC: Adding query filter params (group.id=46080dcc3bfb4524972ed871600a8598, role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=af3932992b7744cba48da1d3cbe4b99c) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:49:59.552531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78c273-f439-4949-ae81-b3ab5297caa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:49:59.553977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78c273-f439-4949-ae81-b3ab5297caa1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:49:59.560567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 224/455] 10.222.0.121 () {56 vars in 1381 bytes} [Mon Aug 1 16:49:59 2022] GET /identity/v3/role_assignments?group.id=46080dcc3bfb4524972ed871600a8598&scope.project.id=af3932992b7744cba48da1d3cbe4b99c&role.id=0b911707f2884d61bd847b72d704811f => generated 613 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:02.233131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2dd76-c6fc-4ac3-8594-78cd73fdab71 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.234195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2dd76-c6fc-4ac3-8594-78cd73fdab71 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.234735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2dd76-c6fc-4ac3-8594-78cd73fdab71 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.236571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 232/456] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:02.242536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3c5e-c31e-4bce-afd5-f9c811ff17d5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.243412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3c5e-c31e-4bce-afd5-f9c811ff17d5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.243885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa3c5e-c31e-4bce-afd5-f9c811ff17d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.261583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:02.268329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-00aa3c5e-c31e-4bce-afd5-f9c811ff17d5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:02.269724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-00aa3c5e-c31e-4bce-afd5-f9c811ff17d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:02.303764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb629-e5e2-4898-8c91-240a79a2fb66 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.304419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb629-e5e2-4898-8c91-240a79a2fb66 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.305398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cb629-e5e2-4898-8c91-240a79a2fb66 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.307568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 233/457] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:02.311977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb983c6-3449-42d6-9d9e-e368a5ea3cc6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.312517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb983c6-3449-42d6-9d9e-e368a5ea3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.313002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb983c6-3449-42d6-9d9e-e368a5ea3cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.322884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:02.344889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3eb983c6-3449-42d6-9d9e-e368a5ea3cc6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:02.346091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3eb983c6-3449-42d6-9d9e-e368a5ea3cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:02.410002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 225/458] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:02.436261 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 234/459] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:50:02.438611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa3c5e-c31e-4bce-afd5-f9c811ff17d5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:02.480300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb983c6-3449-42d6-9d9e-e368a5ea3cc6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:02.603179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa3c5e-c31e-4bce-afd5-f9c811ff17d5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:02.620233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb983c6-3449-42d6-9d9e-e368a5ea3cc6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:02.648506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87755c-43de-4a5a-8557-12bf23014736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:02.649443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87755c-43de-4a5a-8557-12bf23014736 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.649742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87755c-43de-4a5a-8557-12bf23014736 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.650024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87755c-43de-4a5a-8557-12bf23014736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.653757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:02.664249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87755c-43de-4a5a-8557-12bf23014736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:02.665720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87755c-43de-4a5a-8557-12bf23014736 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:02.666054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cbb58-a34c-46f4-a0f4-ba0bb5154d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:02.666971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cbb58-a34c-46f4-a0f4-ba0bb5154d7c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.667626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cbb58-a34c-46f4-a0f4-ba0bb5154d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.668103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cbb58-a34c-46f4-a0f4-ba0bb5154d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.670900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:02.684204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cbb58-a34c-46f4-a0f4-ba0bb5154d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9a87755c-43de-4a5a-8557-12bf23014736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:02.685175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:02.685999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:02.687027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:02.687027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:02.687027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:02.687027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:02.687254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cbb58-a34c-46f4-a0f4-ba0bb5154d7c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:02.689083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 226/460] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:02.690703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a30c8-aa59-4d9e-9f4e-871be83defa7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.691174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a30c8-aa59-4d9e-9f4e-871be83defa7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.692141 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a30c8-aa59-4d9e-9f4e-871be83defa7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.694362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 227/461] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:02.696471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a30c8-aa59-4d9e-9f4e-871be83defa7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b17cbb58-a34c-46f4-a0f4-ba0bb5154d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:02.708808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:02.709694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:02.710726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:02.710726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:02.710726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:02.710726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:02.710726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 235/462] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:02.712135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d2d8-ca05-421e-9a22-6421e6021b8c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.712494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d2d8-ca05-421e-9a22-6421e6021b8c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.712860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d2d8-ca05-421e-9a22-6421e6021b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.732122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8089d2d8-ca05-421e-9a22-6421e6021b8c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:02.733502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8089d2d8-ca05-421e-9a22-6421e6021b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:02.803067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a30c8-aa59-4d9e-9f4e-871be83defa7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:02.810400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 236/463] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:02.811543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d2d8-ca05-421e-9a22-6421e6021b8c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:02.843651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488f11-3b18-40f1-9dca-f39877d9d1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:02.844276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488f11-3b18-40f1-9dca-f39877d9d1eb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.844558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488f11-3b18-40f1-9dca-f39877d9d1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.844836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488f11-3b18-40f1-9dca-f39877d9d1eb None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.845518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488f11-3b18-40f1-9dca-f39877d9d1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:02.845823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488f11-3b18-40f1-9dca-f39877d9d1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:02.847218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488f11-3b18-40f1-9dca-f39877d9d1eb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:02.859923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 228/464] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:02.861130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3236-8663-4f97-b77d-fab4a90f4003 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.861417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3236-8663-4f97-b77d-fab4a90f4003 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.861693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f3236-8663-4f97-b77d-fab4a90f4003 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.866581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 229/465] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:02.867318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f3236-8663-4f97-b77d-fab4a90f4003 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:02.925522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:02.937285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d2d8-ca05-421e-9a22-6421e6021b8c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:02.955863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:02.976281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:02.976908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:02.977190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:02.977541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:02.978236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:02.978572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:02.979946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:02.981478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f3236-8663-4f97-b77d-fab4a90f4003 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:02.999136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 237/466] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:03.000151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.023586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50a044-98a0-4d6c-95fc-9c556fd26ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.024325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50a044-98a0-4d6c-95fc-9c556fd26ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.024617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50a044-98a0-4d6c-95fc-9c556fd26ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.024896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50a044-98a0-4d6c-95fc-9c556fd26ca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.036306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50a044-98a0-4d6c-95fc-9c556fd26ca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.037762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50a044-98a0-4d6c-95fc-9c556fd26ca8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-da50a044-98a0-4d6c-95fc-9c556fd26ca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:03.054478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:03.055431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:03.056299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:03.056299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:03.056299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:03.056299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:03.056299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 230/467] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:03.057264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e741-4c8f-4d54-9327-a15371f54517 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.057264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e741-4c8f-4d54-9327-a15371f54517 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.057422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7e741-4c8f-4d54-9327-a15371f54517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.079333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dea7e741-4c8f-4d54-9327-a15371f54517 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:03.081428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dea7e741-4c8f-4d54-9327-a15371f54517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:03.115469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992244-ee01-49b3-bae9-e097b2aca4db None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.152225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.152882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.153164 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.153435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.154112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.155163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 231/468] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:03.155559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.156357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e741-4c8f-4d54-9327-a15371f54517 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.188112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 238/469] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:50:02 2022] POST /identity/v3/users => generated 247 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:03.188941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.196000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:03.224582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:03.293043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7e741-4c8f-4d54-9327-a15371f54517 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.306666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688fe3a-70d2-4cf8-be16-b5a740bed516 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.334838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.335767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.336239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.336693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.337582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.339368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.354069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.355046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.355494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.355843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.356756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:03.357135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.358646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.374936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 232/471] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:50:03 2022] POST /identity/v3/users => generated 249 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:03.375099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 239/471] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:03.375939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.380460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.506297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:03.520557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:03.526731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a269027-3563-4220-bdfc-16800a67a0ad None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.536175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe018050-72d3-4be0-9960-a957741aeaa5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.575335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.575655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00edde3-57d9-4b3f-866d-41592e81d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.575988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.576268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.576393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00edde3-57d9-4b3f-866d-41592e81d679 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.582842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.582980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00edde3-57d9-4b3f-866d-41592e81d679 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.582980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00edde3-57d9-4b3f-866d-41592e81d679 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.582980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00edde3-57d9-4b3f-866d-41592e81d679 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.582980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00edde3-57d9-4b3f-866d-41592e81d679 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.590081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.592149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.603870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 233/472] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:50:03 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:50:03.605466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15526c-a7b9-42c4-817b-1c7fe248e6e6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.605967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15526c-a7b9-42c4-817b-1c7fe248e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.606456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15526c-a7b9-42c4-817b-1c7fe248e6e6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.608186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 234/473] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:03.612341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:03.613206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:03.614634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:03.614634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:03.614634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:03.614634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:03.614634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 240/474] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:03.615691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e5d5e-4e63-4c8b-8783-49c39161f327 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.615977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e5d5e-4e63-4c8b-8783-49c39161f327 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.616366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e5d5e-4e63-4c8b-8783-49c39161f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.619464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.637392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2c9e5d5e-4e63-4c8b-8783-49c39161f327 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:03.638835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2c9e5d5e-4e63-4c8b-8783-49c39161f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:03.729239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 235/475] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:03.753380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e5d5e-4e63-4c8b-8783-49c39161f327 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.776477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2c54-659d-497a-86c1-b9a0c7ef3b85 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.821753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.822437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.822726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.823061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.823796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:03.824085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.825541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.842326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 241/476] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:03.846524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:03.858062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:03.862757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:03.899697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e5d5e-4e63-4c8b-8783-49c39161f327 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.947439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:03.948467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:03.948861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:03.949237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:03.950238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:03.952442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:03.967490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.sql.core [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 16:50:03.967490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 16:50:03.967490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [parameters: {'id': 'c606aec30547482284c5a94462789871', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 16:50:03.967490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80253) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 16:50:03.977198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515de8-951d-4673-ac1e-74ab09b0b2f1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Aug 01 16:50:03.987791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:50:03.989301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application yield resource Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise self.value Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application session.commit() Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 16:50:03.990511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.flush() Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application compat.raise_( Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 16:50:03.991535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:50:03.992640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:50:03.993718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [parameters: {'id': 'c606aec30547482284c5a94462789871', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:03.994701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 16:50:03.995663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:03.996650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 236/477] 10.222.0.121 () {60 vars in 1136 bytes} [Mon Aug 1 16:50:03 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:03.998962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:04.025894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:04.026718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:04.027150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:04.027996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:04.029154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:04.032167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:04.063844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 242/478] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:50:03 2022] POST /identity/v3/users => generated 250 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:04.129577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426b961-0941-418d-8cdd-1b562e503392 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:04.168251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8082eb-4868-469e-a5b1-3f8e42240bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:04.169086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8082eb-4868-469e-a5b1-3f8e42240bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:04.169474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8082eb-4868-469e-a5b1-3f8e42240bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:04.169759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8082eb-4868-469e-a5b1-3f8e42240bf7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:04.177799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:04.189138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8082eb-4868-469e-a5b1-3f8e42240bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9b8082eb-4868-469e-a5b1-3f8e42240bf7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:04.194875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:04.196964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:04.198889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 237/479] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:04.202943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:04.276268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:04.322788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dc64a-70ff-4c37-bf40-b5d3103252a3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:04.358828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733e856-8350-4a88-b864-11eb8add5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:04.359457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733e856-8350-4a88-b864-11eb8add5c6e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:04.359737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733e856-8350-4a88-b864-11eb8add5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:04.360012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733e856-8350-4a88-b864-11eb8add5c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:04.360840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733e856-8350-4a88-b864-11eb8add5c6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:04.361190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733e856-8350-4a88-b864-11eb8add5c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:04.362586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733e856-8350-4a88-b864-11eb8add5c6e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:04.371694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 243/480] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:05.600279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937299a-555e-4f47-bbcf-82f8eed150f4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:05.601265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937299a-555e-4f47-bbcf-82f8eed150f4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:05.601749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937299a-555e-4f47-bbcf-82f8eed150f4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:05.603574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 238/481] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:05.609035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43463-45d5-40d1-b31f-b21cc6ecfac8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:05.609828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43463-45d5-40d1-b31f-b21cc6ecfac8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:05.610354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f43463-45d5-40d1-b31f-b21cc6ecfac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:05.635213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a3f43463-45d5-40d1-b31f-b21cc6ecfac8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:05.636729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a3f43463-45d5-40d1-b31f-b21cc6ecfac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:05.727787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 244/482] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:05.751172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937299a-555e-4f47-bbcf-82f8eed150f4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:05.858082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937299a-555e-4f47-bbcf-82f8eed150f4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:05.908001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:05.909052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:05.909536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:05.910035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:05.931791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:05.937107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:05.937963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:05.938765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:05.941396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 239/483] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:05.948364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f43463-45d5-40d1-b31f-b21cc6ecfac8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.004887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:06.072211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f43463-45d5-40d1-b31f-b21cc6ecfac8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:06.119019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290cce1-75b5-4d4b-9af1-ae224a7a8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:06.119996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290cce1-75b5-4d4b-9af1-ae224a7a8b2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.120497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290cce1-75b5-4d4b-9af1-ae224a7a8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.120981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290cce1-75b5-4d4b-9af1-ae224a7a8b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.121941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290cce1-75b5-4d4b-9af1-ae224a7a8b2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:06.122537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290cce1-75b5-4d4b-9af1-ae224a7a8b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:06.124115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290cce1-75b5-4d4b-9af1-ae224a7a8b2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:06.134752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 245/484] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:06.140667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.193416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f51110-55f8-4db4-b1c4-1846d98d8dde None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.193738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f51110-55f8-4db4-b1c4-1846d98d8dde None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.193976 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f51110-55f8-4db4-b1c4-1846d98d8dde None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.195630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 246/485] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:06.200475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c205-7b2d-492a-99b8-6b4c0b9bc017 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.200768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c205-7b2d-492a-99b8-6b4c0b9bc017 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.201053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2c205-7b2d-492a-99b8-6b4c0b9bc017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.227031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8ba2c205-7b2d-492a-99b8-6b4c0b9bc017 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:06.228237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8ba2c205-7b2d-492a-99b8-6b4c0b9bc017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:06.231827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:06.308619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5eb1-0e43-4991-95b4-c01c0fc1a397 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:06.363462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 247/486] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:06.364788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ed8c-7f16-48c0-a847-7a348c821a9b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.365081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ed8c-7f16-48c0-a847-7a348c821a9b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.365362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ed8c-7f16-48c0-a847-7a348c821a9b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.367147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 248/487] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:06.373740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81b00e-cbf1-4bf5-b790-1f1a7f211f45 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.373976 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81b00e-cbf1-4bf5-b790-1f1a7f211f45 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.374247 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81b00e-cbf1-4bf5-b790-1f1a7f211f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.378348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:06.379539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.379830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.380110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.393484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:06.395852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:06.402767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-da81b00e-cbf1-4bf5-b790-1f1a7f211f45 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:06.404073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da81b00e-cbf1-4bf5-b790-1f1a7f211f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:06.413689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:06.414583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:06.415715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:06.415715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:06.415715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:06.415715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:06.416133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 240/488] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:06.417201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.448753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:06.498829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 249/489] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:06.500177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81b00e-cbf1-4bf5-b790-1f1a7f211f45 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.560226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6c2d9-8fc6-4d36-aa79-721d358e0a8f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:06.570751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:06.607289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:06.608082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.608249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.608499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.633568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:06.647221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81b00e-cbf1-4bf5-b790-1f1a7f211f45 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:06.649132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:06.650803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:06.654236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:06.655735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 241/490] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:06.657065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.693523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:06.694301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.694560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.694836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.695592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:06.695894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:06.697718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:06.712118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 250/491] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:06.712974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.762533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:06.814277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429087b-a5ad-45a5-ad1e-521fb44059e4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:06.834394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17aba8-02c8-4e69-80cf-9559bd183dec None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:06.859994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:06.860758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.861021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.861303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.872902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:06.876375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:06.877257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:06.877741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:06.878215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:06.879164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:06.880007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:06.880803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:06.882022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:06.882570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:06.884286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:06.885272 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 242/492] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:06.886183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.897386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 251/493] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:06.898627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:06.923615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.002720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c5e59-5a15-4bc6-a499-084a125d560c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.022846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.029436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28770d68-5f6c-4d1d-8e01-80fb85ae1228 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.038202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.038890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.039176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.039452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.048660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.050094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:07.062776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:07.063832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 243/494] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:50:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:07.065401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.066109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9ff58-86bb-4824-ba40-7052120bac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.066109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9ff58-86bb-4824-ba40-7052120bac33 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.066109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9ff58-86bb-4824-ba40-7052120bac33 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.066109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9ff58-86bb-4824-ba40-7052120bac33 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.067387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9ff58-86bb-4824-ba40-7052120bac33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:07.067934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9ff58-86bb-4824-ba40-7052120bac33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.070210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9ff58-86bb-4824-ba40-7052120bac33 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.080098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 252/495] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:07.081179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088dc7-b139-4576-8132-6b205cc400d1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.081482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088dc7-b139-4576-8132-6b205cc400d1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.081768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33088dc7-b139-4576-8132-6b205cc400d1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.083652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 253/496] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:07.085223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d12798-0222-4b05-b2a8-b9dd6d71590c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.085647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d12798-0222-4b05-b2a8-b9dd6d71590c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.086066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d12798-0222-4b05-b2a8-b9dd6d71590c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.087508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 254/497] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:07.088079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d12798-0222-4b05-b2a8-b9dd6d71590c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.161666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.173769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d8c24-a898-4a68-9680-2d7342eedcfa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.190453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d12798-0222-4b05-b2a8-b9dd6d71590c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.207407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.208078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.208358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.208629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.219237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.220744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.224581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0a36-16a3-4862-b2f6-de3c33f6e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.225205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0a36-16a3-4862-b2f6-de3c33f6e976 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.225604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0a36-16a3-4862-b2f6-de3c33f6e976 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.225888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0a36-16a3-4862-b2f6-de3c33f6e976 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.226718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0a36-16a3-4862-b2f6-de3c33f6e976 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:07.227037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0a36-16a3-4862-b2f6-de3c33f6e976 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.228579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0a36-16a3-4862-b2f6-de3c33f6e976 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:07.235351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:07.236179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:07.237003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:07.237003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:07.237003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:07.237003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:07.237003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 244/498] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:07.237269 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.267556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 255/499] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:07.268864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f762-8816-44e9-8535-410175cf0dc0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.269158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f762-8816-44e9-8535-410175cf0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.269446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f762-8816-44e9-8535-410175cf0dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.287520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fe34f762-8816-44e9-8535-410175cf0dc0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:07.288723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fe34f762-8816-44e9-8535-410175cf0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:07.299538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.337936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3414d1-a3a2-4e43-bda4-29052133a0a7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.361307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 256/500] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:07.364731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe92cc5-9ff6-419b-850b-767e58547da2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.365177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe92cc5-9ff6-419b-850b-767e58547da2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.365461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe92cc5-9ff6-419b-850b-767e58547da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.371862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.373288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.373573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.373848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.382676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dfe92cc5-9ff6-419b-850b-767e58547da2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:07.383676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.383987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dfe92cc5-9ff6-419b-850b-767e58547da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:07.385892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.388118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:07.405852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:07.406814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:07.407640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:07.407640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:07.407640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:07.407640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:07.407640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 245/501] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:07.408739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.455012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 257/502] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:07.455939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe92cc5-9ff6-419b-850b-767e58547da2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.514410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321fb7-709c-4895-a0af-90f78ed092d4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.534005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.547951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.548575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.548858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.549140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.549827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:07.550135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.551580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.557918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe92cc5-9ff6-419b-850b-767e58547da2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.562972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 246/503] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:07.563766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.592981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.593608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.593886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.594160 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.616237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.664551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.667256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.668406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0082b19-8bdd-4782-bb37-93feed1483ad None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.705623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.706192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.706503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.706779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.717196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:07.722114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:07.723615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:07.724432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 247/504] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:07.725271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.750088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.775898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 258/505] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:07.776727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.825689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf5aa-811f-4bab-9b05-73b0e20b7e0b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.838445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.859040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.859651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.859932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.860206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.860888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:07.861192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.862577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.873787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 248/506] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:07.873928 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29114-0cdf-452a-9763-cb51aad13a7a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:07.874600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.911713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:07.912360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:07.912641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:07.912912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:07.922918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:07.924377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:07.939324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:07.940195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:07.941034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:07.941034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:07.941034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:07.941034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:07.941034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 259/507] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:07.942097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:07.973010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:07.976969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16292c78-95bd-461b-89cf-532b52037dec None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.009691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.010357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.010645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.010918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.018163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.020204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:08.031949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:08.033005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:08.033937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 249/508] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:08.034534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.046717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7d6a3-67b1-4aeb-80d0-ff47f58d1311 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.068052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.080008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.080628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.080907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.081183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.081887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:08.082765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.084141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.092280 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 260/509] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:08.093118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.137343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0bcc7-98d2-4996-8f74-1d95052d199d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.170194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.171058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.171338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.171614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.182505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.183935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.185728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.197211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e513bc6-dfb8-4d39-a731-7f9a18bcb372 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:08.198749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:08.199601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:08.200440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:08.200440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:08.200440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:08.200440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:08.200440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 250/510] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:08.200696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.233821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.234548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.234830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.235103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.242849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.244328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:08.256531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:08.257486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:08.258403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 261/511] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:08.258997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.287229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.305789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ccee-2097-40d7-9129-f3f4871bdb87 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.341536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.342157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.342519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.342798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.343492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:08.343798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.345172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.357392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 251/512] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:08.358092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.368948 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579b22e-709a-49dd-b21c-c7956ead9ffc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.402169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.402816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.403097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.403374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.404154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:08.404459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.405896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.422447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 262/513] 10.222.0.121 () {56 vars in 1142 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:08.423238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.434103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.460697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced692-aaed-4adf-87bc-da5e7f39ad21 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.494121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.494725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.495004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.495280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.505080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.506560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.509114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:08.522359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:08.523345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:08.524466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:08.524466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:08.524466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:08.524466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:08.524466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 252/514] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:08.524790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.528147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a787b-ff99-4a4e-8c6c-16e37fe2fea0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.568101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.568909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.569345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.569774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.571156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:08.571637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.573510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.587149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 263/515] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:08.588352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.621879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3f7e-fdd0-4dad-939e-74aaba0fec8d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.654227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.654872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.655160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.655440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.656234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:08.656545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.657968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.665910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.694753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 253/516] 10.222.0.121 () {56 vars in 1142 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:08.695669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.701044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625f8df-d07f-4a6e-a1b2-c03542135b96 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.735111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.735731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.736016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.736296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.736971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.738993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.750087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.760305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 264/517] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:50:08 2022] POST /identity/v3/users => generated 248 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:08.761114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.806853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2524cc-2d74-46b6-ae3c-0b3f54e89fe3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.845719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.846467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.846757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.847043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.905029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8fa14-5c82-457a-b403-7882af723bdb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:08.925399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.927488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.933485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:08.953834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:08.954768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:08.955222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:08.955505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:08.956218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:08.956529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:08.957996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:08.970874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 265/518] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:08.971720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:08.988785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.036572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 254/519] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:09.037156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.084122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83319215-199f-4753-9e6d-da7c7cd17ae3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.123182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.123839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.124193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.124474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.132034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.133675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.145849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cef2d-505e-4b92-912b-fe08aa880d05 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:09.146168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:09.147005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:09.147827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 266/520] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:09.148273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.186265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.186903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.187188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.187468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.196728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.213307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.260701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.261485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa099-71f2-4edf-9674-08fe5583f5ab None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.262168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.301323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.302032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.302447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.302845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.310730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.312316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:09.324402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:09.325519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:09.326574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 267/521] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:09.331425 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.374336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 255/522] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:09.375491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.435900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.454121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628bb9b-1903-4882-b1bf-04089809f4e1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.457057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.482756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69895fa-878a-48a8-8644-73d2f3a0c289 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.492331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.493050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.493334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.493612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.505066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.506593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.520692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.521466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.521849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:09.521947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:09.522925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:09.524155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:09.524155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:09.524155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:09.524155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:09.524155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 268/523] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:09.524155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.527630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.528658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:09.528896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.530363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.553744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 256/524] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:09.553744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.637712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc558b9e-8e08-4b87-8fa5-c92e6e664246 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.660283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318fd3-9499-405b-9c85-d02fa69513fb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.671559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.672186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.672472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.672762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.673549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:09.673861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.675342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.679484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.698304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 269/525] 10.222.0.121 () {56 vars in 1144 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:09.698304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.708537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.709519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.710499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.710987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.714512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.726439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.727939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:09.745883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:09.747009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:09.748092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:09.748092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:09.748092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:09.748092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:09.748092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 257/526] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:09.748092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.813185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2080-72fa-48f2-a71e-54cab91ca891 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.851080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.851710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.851995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.852333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.852977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:09.853291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.854701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.863551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a74089-b08a-4075-855d-04ae2c7fa05d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:09.866899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 270/527] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:09.867910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.904142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:09.904779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:09.905071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:09.905338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:09.906185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fa3215124493472d89807ab5845258fb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:09.906493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:09.908033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:09.923585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 258/528] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/role_assignments?user.id=fa3215124493472d89807ab5845258fb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:09.923585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:09.962326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.976066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:09.994482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf41b75-6c5e-429f-8d11-f06dae473857 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.039043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.039415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.039642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.039926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.076071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9d0c0-b50d-4dde-9289-9760d562c1b2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.117529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.118203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.118521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.118799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.119500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:10.119806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.121336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.124186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.125861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.136882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 259/529] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:10.138457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.206277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:10.235641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 271/530] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:10.236879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.247506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:10.258071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429cbb-8495-4bb4-b07c-1c9bbf45aa0c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.295188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.295984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.296167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.296391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.303563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.304865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:10.317586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:10.318512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:10.319340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:10.324143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 260/531] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:10.325266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.352984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d75473-7074-402f-82ce-8b9d75edf6cc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.391242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.392244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.392727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.393200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.401734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.403500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:10.416344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:10.417216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:10.418049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:10.420613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 272/532] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:10.421852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.434835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29e490-4248-4586-80f4-b28cf4c89bcc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.459505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:10.470308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.470900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.471183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.471452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.483301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.484761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:10.500580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:10.501500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:10.502404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:10.502404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:10.502404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:10.502404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:10.507031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 261/533] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:10.507670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.511424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:10.532732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40db61-9d68-4799-90d0-e59954ac060d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.568682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.569369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.569664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.569965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.570745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:10.571168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.572696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.592172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 273/534] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:10.593286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.621938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c859bbd-1f26-4142-9c47-37719e50be0f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.657872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.658870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.659373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.659840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.661378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:10.662384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.664037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.678887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 262/535] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:10.680149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.699384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcd5f8-d425-49f9-b919-610ee125f1a3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.702586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:10.735595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.736278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.736564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.737167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.737589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:10.737909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.739874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.747205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:10.751823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 274/536] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:10.752653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.790619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1739ba3-0bca-4695-ac4b-44656e7ad6b7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.826458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.827471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.827947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.828412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.829470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=bf25e3be640643c1a11fc21e08efdc70) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:10.829983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.831623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.838249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 263/537] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/role_assignments?user.id=bf25e3be640643c1a11fc21e08efdc70&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:10.839343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:10.862103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197a388-3e8c-41e4-a6d8-896a37f8dd4b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:10.907097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855b8ff-5563-42d3-aa89-ea0808933809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:10.907803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b8ff-5563-42d3-aa89-ea0808933809 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.908088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b8ff-5563-42d3-aa89-ea0808933809 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.908421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855b8ff-5563-42d3-aa89-ea0808933809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.909235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855b8ff-5563-42d3-aa89-ea0808933809 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=3e9b1bcc6f8e4bbdacf66021bfe57bbb) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:10.909548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855b8ff-5563-42d3-aa89-ea0808933809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:10.911638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855b8ff-5563-42d3-aa89-ea0808933809 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:10.918641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 275/538] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/role_assignments?user.id=3e9b1bcc6f8e4bbdacf66021bfe57bbb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:10.919798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7806-1a72-4ddb-b575-0a2a5e0c67d3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.920020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7806-1a72-4ddb-b575-0a2a5e0c67d3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.920303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c7806-1a72-4ddb-b575-0a2a5e0c67d3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.922165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 276/539] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:10.928408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bab3c-1d60-413a-9ea3-fb6d162b4495 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:10.928734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bab3c-1d60-413a-9ea3-fb6d162b4495 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:10.928980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bab3c-1d60-413a-9ea3-fb6d162b4495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:10.949800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dd0bab3c-1d60-413a-9ea3-fb6d162b4495 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:10.951141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dd0bab3c-1d60-413a-9ea3-fb6d162b4495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:10.971635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:10.974782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d309-57be-47e6-bde9-3018479ae7f6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:11.010744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:11.029649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:11.030391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:11.030664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:11.030945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:11.046939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:11.048440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:11.067617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:11.068505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:11.069328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:11.072066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 264/540] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:11.077415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:11.077680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 277/541] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:50:11.102802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bab3c-1d60-413a-9ea3-fb6d162b4495 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:11.219923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0ef0f-f19e-4ecb-9534-6948eddacb4b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:11.225023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bab3c-1d60-413a-9ea3-fb6d162b4495 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:11.264064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:11.264967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:11.265421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:11.265849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:11.277996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:11.283919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:11.284970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:11.285869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:11.288540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 278/542] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:11.294694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:11.310378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:11.311245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:11.311703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:11.312129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:11.313048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:11.313542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:11.319611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:11.322624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:11.350621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 265/543] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:11.360213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:11.417419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:11.480931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d18f85-5f40-48c6-a6ef-c883843eff63 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:11.525205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f01d-1012-49fa-afcb-4a5fad13c97c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:11.527989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:11.529736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:11.530221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:11.530742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:11.531726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=112c65065f6d4c5990f3952e0099cb54) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:11.532233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:11.533861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:11.543788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 266/544] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:11 2022] GET /identity/v3/role_assignments?user.id=112c65065f6d4c5990f3952e0099cb54&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:11.593040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:11.593693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:11.593981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:11.594282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:11.595033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:11.595347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:11.596833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:11.617133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 279/545] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:11.622911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:11.745063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa21b-c986-4097-b403-1256e5961e50 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:11.758053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:11.784486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:11.786029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:11.786596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:11.787073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:11.803448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:11.804986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:11.820352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:11.821252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:11.822074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:11.822074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:11.822074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:11.822074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:11.822074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 267/546] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:11.827461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:11.931494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:11.971021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e519c17-b06f-4c5d-8532-0bbb47a6b8ff None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:12.023064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe441d-9c4f-4965-b31f-c4696861eab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:12.023609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe441d-9c4f-4965-b31f-c4696861eab7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.023892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe441d-9c4f-4965-b31f-c4696861eab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.024260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe441d-9c4f-4965-b31f-c4696861eab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.024949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe441d-9c4f-4965-b31f-c4696861eab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:12.025249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe441d-9c4f-4965-b31f-c4696861eab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:12.026640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe441d-9c4f-4965-b31f-c4696861eab7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:12.041466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 280/547] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:12.046964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:12.151061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be4de6-8a5d-4e06-9583-fd2e54002aa4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:12.185921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:12.190554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.190854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.191152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.199726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:12.201226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:12.217868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:12.218817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:12.220252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 268/548] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:12.222204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd14c-6332-41c9-a208-0240812e16fa None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.223259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd14c-6332-41c9-a208-0240812e16fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.223816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcd14c-6332-41c9-a208-0240812e16fa None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.225221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:12.225848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 281/549] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:12 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:50:12.231089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ffbde-a059-43e9-8324-0c0d5abb4869 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.231645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ffbde-a059-43e9-8324-0c0d5abb4869 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.232130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ffbde-a059-43e9-8324-0c0d5abb4869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.252188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d44ffbde-a059-43e9-8324-0c0d5abb4869 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:12.253710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d44ffbde-a059-43e9-8324-0c0d5abb4869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:12.265209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:12.333144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 282/550] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:50:12.357332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ffbde-a059-43e9-8324-0c0d5abb4869 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:12.422229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:12.433758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6328-5c0f-4455-abe6-3819589921c7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:12.469112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ffbde-a059-43e9-8324-0c0d5abb4869 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:12.505369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:12.506014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.506321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.506600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.507401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:12.507709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:12.509192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:12.511133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:12.512154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.512699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.513464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.525441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:12.531154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:12.532120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:12.533035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:12.536291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 283/551] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:12.542737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 269/552] 10.222.0.121 () {56 vars in 1140 bytes} [Mon Aug 1 16:50:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:12.547531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:12.548661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:12.695121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:12.735050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec5244-e29d-49de-b03a-6e142b68e392 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:12.746447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0f5e9-8241-484c-98ce-e764a18a2a70 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:12.779856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:12.796826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:12.797813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.798349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.798888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.799946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:12.800457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:12.802098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:12.811416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:12.811926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:12.812155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 284/553] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:12.812256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:12.817024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:12.818221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:12.885519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:12.887007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:12.940957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4675e-9f63-4aea-b7c2-ae1ca01c23c8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:12.973262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:12.996128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 270/554] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:13.000779 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.001918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.005994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.011666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.012235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.032435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:13.033864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:13.072245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:13.073184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:13.074027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:13.074027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:13.074027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:13.074027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:13.074794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 285/555] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:13.083490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.137399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63585f-2fa8-418e-a9fe-ba47034bb9b2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:13.157136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:13.210993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.211652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.211936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.212212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.234697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:13.236092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:13.268786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd17dcd-2ede-44b4-8b59-33c30bba9406 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:13.271935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:13.272761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:13.274178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:13.274178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:13.274178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:13.274178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:13.274178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 271/556] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:13.280476 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.315796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.316945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.317298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.317771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.318700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:13.319065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:13.320712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:13.336926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 286/557] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:13.343103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.359600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:13.438043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80de1ac-877d-4e06-a434-48d63510df1c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:13.497361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0266144-a7a9-4c3b-b9f0-782326ea3eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.498008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:13.499277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266144-a7a9-4c3b-b9f0-782326ea3eff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.499766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266144-a7a9-4c3b-b9f0-782326ea3eff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.500295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266144-a7a9-4c3b-b9f0-782326ea3eff None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.501186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266144-a7a9-4c3b-b9f0-782326ea3eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:13.501692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266144-a7a9-4c3b-b9f0-782326ea3eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:13.503485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266144-a7a9-4c3b-b9f0-782326ea3eff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:13.505397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2ce1a-b03b-4a91-88f0-c1be61d41fd4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:13.518090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 272/558] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:13.521175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faba9e-c42c-406b-890e-316716d9e75b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.521467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faba9e-c42c-406b-890e-316716d9e75b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.521745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faba9e-c42c-406b-890e-316716d9e75b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.523048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 273/559] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:13.524206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9352a-ee86-40f0-adf2-fec53eb2b107 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.524499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9352a-ee86-40f0-adf2-fec53eb2b107 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.524770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9352a-ee86-40f0-adf2-fec53eb2b107 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.527297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 274/560] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:13 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:13.527297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9352a-ee86-40f0-adf2-fec53eb2b107 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.551058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119d838-a29d-491c-ad47-f8c9f111e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.551829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119d838-a29d-491c-ad47-f8c9f111e71a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.552120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119d838-a29d-491c-ad47-f8c9f111e71a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.552400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119d838-a29d-491c-ad47-f8c9f111e71a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.560187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119d838-a29d-491c-ad47-f8c9f111e71a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:13.561641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119d838-a29d-491c-ad47-f8c9f111e71a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2119d838-a29d-491c-ad47-f8c9f111e71a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:13.573918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:13.574927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 287/561] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455eba4-a5dc-4f35-a4f1-c9c582181165 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.580524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455eba4-a5dc-4f35-a4f1-c9c582181165 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.581246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455eba4-a5dc-4f35-a4f1-c9c582181165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.596318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8455eba4-a5dc-4f35-a4f1-c9c582181165 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:13.597621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8455eba4-a5dc-4f35-a4f1-c9c582181165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:13.632913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:13.645633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9352a-ee86-40f0-adf2-fec53eb2b107 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:13.674322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 288/562] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:13.676454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922e80f-efd9-450d-a506-b0eada4750a6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.676776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922e80f-efd9-450d-a506-b0eada4750a6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.677063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922e80f-efd9-450d-a506-b0eada4750a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.684178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.685057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.685531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.685968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.694129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:13.695835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:13.696172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5922e80f-efd9-450d-a506-b0eada4750a6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:13.697553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5922e80f-efd9-450d-a506-b0eada4750a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:13.708774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:13.709671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:13.710949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:13.714570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 275/563] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:13.715404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.772362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 289/564] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:13.773163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922e80f-efd9-450d-a506-b0eada4750a6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.794580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:13.829983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4911d-efff-46db-b266-c6d3e055c41a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:13.864173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.865026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.865309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.865587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.866400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:13.866777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:13.868348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:13.890930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 276/565] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:13.892060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:13.895591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922e80f-efd9-450d-a506-b0eada4750a6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:13.911227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:13.937536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:13.938186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:13.938502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:13.938786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:13.950100 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:13.955036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:13.955938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:13.956766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 290/566] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:13.957544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.006702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2fbce-3fc1-48a5-9823-edb27cb5fa69 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.033689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.039893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.040518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.040798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.041073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.041817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:14.042126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.043581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.055351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 277/567] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:14.056157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.060538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cdc31-435f-4a2d-82e7-02ff82e6df1e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.093650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.094321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.094611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.094885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.105397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:14.110283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:14.111404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 291/568] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:14.112331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.125734 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.157516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1708-e4be-4e65-80fe-c9102b21f424 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.191875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e593a79-2777-4263-ae1e-7f8c27837519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.192522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593a79-2777-4263-ae1e-7f8c27837519 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.192810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593a79-2777-4263-ae1e-7f8c27837519 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.193090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593a79-2777-4263-ae1e-7f8c27837519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.203347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e593a79-2777-4263-ae1e-7f8c27837519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.204867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e593a79-2777-4263-ae1e-7f8c27837519 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.213131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13249-1cdf-42ee-8382-a7f547ad2131 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7e593a79-2777-4263-ae1e-7f8c27837519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:14.218653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:14.219688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:14.220578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:14.220578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:14.220578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:14.220578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:14.220578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 278/569] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:14.221009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004465c0-bd4e-4283-b7de-82bf6700ca94 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.221299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004465c0-bd4e-4283-b7de-82bf6700ca94 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.221575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004465c0-bd4e-4283-b7de-82bf6700ca94 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.222832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 279/570] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:14 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:14.223517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004465c0-bd4e-4283-b7de-82bf6700ca94 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.253291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.254487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.254777 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.255061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.255781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:14.256089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.257465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.258850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.266590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 292/571] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:14.267383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.326233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004465c0-bd4e-4283-b7de-82bf6700ca94 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.348615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.360532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.361142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.361421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.361693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.362496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fc5b0b0e563f46c693361b1f9bfc66d5) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:14.362804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.364741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.367138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bd80a-e538-47f7-bfa5-c93e925fad06 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.370052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 280/572] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/role_assignments?user.id=fc5b0b0e563f46c693361b1f9bfc66d5&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 260 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:14.370880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.412179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db97c2-32ee-478d-83c3-5f273113e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.412817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db97c2-32ee-478d-83c3-5f273113e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.413107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db97c2-32ee-478d-83c3-5f273113e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.413390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db97c2-32ee-478d-83c3-5f273113e0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.414124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db97c2-32ee-478d-83c3-5f273113e0d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:14.414466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db97c2-32ee-478d-83c3-5f273113e0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.415877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db97c2-32ee-478d-83c3-5f273113e0d5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.425036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 293/573] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:14.426939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490c6c2-6b0b-4921-aafd-e71c85c90f9a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.427234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490c6c2-6b0b-4921-aafd-e71c85c90f9a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.427509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490c6c2-6b0b-4921-aafd-e71c85c90f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.447407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b490c6c2-6b0b-4921-aafd-e71c85c90f9a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:14.448652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b490c6c2-6b0b-4921-aafd-e71c85c90f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:14.508137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.520286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b67ff-7b12-46cc-87b1-f87118be3ea5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.524139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 294/574] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:14.525159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490c6c2-6b0b-4921-aafd-e71c85c90f9a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.560637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.561276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.561562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.561843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.562644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:14.562955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.564404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.578142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 281/575] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:14.579018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.632353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.638666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490c6c2-6b0b-4921-aafd-e71c85c90f9a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.688733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.689539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.690823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.690823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.702776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3edb7-7466-4afa-bd21-c9e41e878208 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.705560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.707301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:14.722967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:14.723884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:14.724753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:14.724753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:14.724753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:14.724753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:14.724753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 295/576] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:14.725019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.747814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.748499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.748788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.749071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.759969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.761419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.776903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:14.777078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:14.778187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:14.779198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:14.779198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:14.779198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:14.779198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:14.779198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 282/577] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:14.779198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.859710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37fbd4-a6da-499b-9c19-29042d64b004 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.895358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:14.900284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2401c8-a44d-46e4-b207-ee9918bad4e2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:14.907860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.908888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.910742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.910998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.927746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:14.933869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:14.935039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:14.936128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 296/578] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:14.936904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:14.951912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:14.953139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:14.953617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:14.954104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:14.962729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:14.964228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:14.977169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:14.978099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:14.979182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 283/579] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:14.980048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.055552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:15.059787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e22716-c7d3-442d-ab1a-be3012c4a3e0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.098175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e65c84-1376-46cc-96b0-4d23e8040a76 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.115761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.116508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.116618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.116866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.117567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:15.117876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.119286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.132383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 297/580] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:15.133068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.138950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.139711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.139996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.140395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.141101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:15.141406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.142808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.155519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 284/581] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:15.156349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.176651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:15.262609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f8ced-5ea8-46d9-b69b-f1ea1b8d887c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.263823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a15e1-3fd2-45c5-863c-1c9579cb037c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.301880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.302535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.302817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.303091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.303809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:15.304039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.304146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.304737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.305080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.305418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.305507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.306228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:15.306632 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.308038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.319130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 298/582] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:15.319130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.330900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 285/583] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:15.330900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.348388 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:15.416500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:15.451424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bb426-4f1f-47f2-a628-00ecbd12a325 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.452799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e21cf-43da-4a8c-aff0-9bafa8e6cbbc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.488659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.489208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.489354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.489598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.489903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.490009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.490171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.490478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.497861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.499133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.499333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.500552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:15.511703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:15.512696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:15.514583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 299/584] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:15.515178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:15.517997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:15.518963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:15.520729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 286/585] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:15.523250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.625960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:15.631726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2feba1-5f8e-4f6a-b00e-ee393ced3781 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.646221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e2ad0-da38-44fc-b199-428bab64984e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.670221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.671056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.671349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.671630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fa3215124493472d89807ab5845258fb/roles/6f8906aa325c40b491f8a8fc312f5139` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.680465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:15.681177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.681953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.682327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.682716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.688974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=fa3215124493472d89807ab5845258fb, role_id=6f8906aa325c40b491f8a8fc312f5139)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.690779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.694049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.695798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.704305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 287/586] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:15 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fa3215124493472d89807ab5845258fb/roles/6f8906aa325c40b491f8a8fc312f5139 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:50:15.705262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:15.713512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:15.714843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:15.715882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:15.715882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:15.715882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:15.715882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:15.721829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 300/587] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:15.721829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.866410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd85a1-41d6-470c-8545-82c371703525 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.868433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c2441-e129-4ea0-83c0-8765065a5499 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:15.914056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.915224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.915408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.915744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.916612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:15.916925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.919060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.923794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:15.924344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:15.924624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:15.924896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:15.926188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:15.926530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:15.927962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:15.930123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:15.953492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 288/588] 10.222.0.121 () {56 vars in 1142 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:15.954469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:15.955171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 301/589] 10.222.0.121 () {56 vars in 1142 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:15.959437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.023621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:16.080383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49efd-c0f2-4a8d-85bb-90715763838e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.097297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5ce3c-6a97-4672-8e3f-57ea4e067ef9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.127690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.128346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.128658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.128940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.139193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.140222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.140947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.141428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.142345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:16.142453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.142966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.143813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.145179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.158666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 289/590] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:16.160705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:16.162467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:16.163348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:16.164632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:16.164632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:16.164632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:16.164632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:16.164632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 302/591] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:16.170414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.227213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:16.290103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e33d4-8e3d-4ba9-814f-153e9fd85e5c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.298166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:16.303703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c4598-856c-422a-a75d-10ce1a0b5411 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.330920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.332536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.333022 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.333525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.345988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.348319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.349508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.350162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.350575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.350887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.360829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.362522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:16.367075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:16.367934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:16.368810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:16.368810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:16.368810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:16.368810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:16.371359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 290/592] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:16.372371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:16.380706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:16.381849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:50:16.383008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:16.385534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 303/593] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:16.392395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.495028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b34f-5cfc-46a5-8a1b-955ba4e1d46e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.527869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b6102-fdf5-4a34-b7ea-9aa843d64f91 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.529856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.530512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.530794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.531067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.531415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:16.531770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:16.532078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.533440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.549946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 291/594] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:16.549946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.568877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:16.571561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9f78c-6cf2-40df-abe4-96ee46f186f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.572324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9f78c-6cf2-40df-abe4-96ee46f186f5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.572672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9f78c-6cf2-40df-abe4-96ee46f186f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.573030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9f78c-6cf2-40df-abe4-96ee46f186f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.573799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9f78c-6cf2-40df-abe4-96ee46f186f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:16.574114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9f78c-6cf2-40df-abe4-96ee46f186f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.575520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9f78c-6cf2-40df-abe4-96ee46f186f5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.588060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 304/595] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:16.588060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63998-bfb9-448a-ae9f-a230199d2907 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.588060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63998-bfb9-448a-ae9f-a230199d2907 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.588060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63998-bfb9-448a-ae9f-a230199d2907 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.595159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 305/596] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:16 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:16.595941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63998-bfb9-448a-ae9f-a230199d2907 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.666094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f531-6ce0-42e3-93df-70d385a2ddb1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.701620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.702246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.702556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.702836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.703631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:16.703941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.705366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.720101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63998-bfb9-448a-ae9f-a230199d2907 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.728419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 292/597] 10.222.0.121 () {56 vars in 1144 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:16.728419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.758722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4282a-0752-47e9-9bf0-3e7a49e424c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.759386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4282a-0752-47e9-9bf0-3e7a49e424c0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.759683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4282a-0752-47e9-9bf0-3e7a49e424c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.759963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4282a-0752-47e9-9bf0-3e7a49e424c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.767161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4282a-0752-47e9-9bf0-3e7a49e424c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.768602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4282a-0752-47e9-9bf0-3e7a49e424c0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-36c4282a-0752-47e9-9bf0-3e7a49e424c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:16.780710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:16.781782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:16.782724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 306/598] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:16.783448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc1fa8-f6a0-428f-bd89-b63f0e417753 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.783739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc1fa8-f6a0-428f-bd89-b63f0e417753 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.784021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc1fa8-f6a0-428f-bd89-b63f0e417753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.802047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ecfc1fa8-f6a0-428f-bd89-b63f0e417753 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:16.803290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ecfc1fa8-f6a0-428f-bd89-b63f0e417753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:16.812202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:16.822859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:16.838061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ed1f7-7159-40e2-b318-6f88a5f5d9d8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:16.878301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:16.878301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:16.878301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:16.878301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:16.879295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 307/599] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:16.879295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc1fa8-f6a0-428f-bd89-b63f0e417753 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:16.894396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:16.896739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:16.913498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:16.915740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 293/600] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:16.916628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.008843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc1fa8-f6a0-428f-bd89-b63f0e417753 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.032708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905ca84-57f0-4cb0-8eb2-fa23cf05ffbf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.044304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.044950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.045235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.045514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.055634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.057087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.066784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.067401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.067681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.068011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.068750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:17.069106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.070539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:17.072299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:17.073153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:17.074033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:17.074033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:17.074033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:17.074033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:17.074924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.078117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 308/601] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:17.079051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.092136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 294/602] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:17.092136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.092837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.187703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898273c-8b3f-4f29-bcd5-b8ce498b23ba None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.194966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e4f53-92fe-4291-940a-e8bf1432028d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.225086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.225860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.226237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.226634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.232410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.233114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.233470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.233818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.234684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:17.235076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.236600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.237822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:17.243526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:17.244613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:17.245660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:17.246723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 309/603] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:17.247405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.256886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 295/604] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:17.257581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.322980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.324630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.361626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab3fe-0619-498e-a186-4d45fc3a93c1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.377223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b79b0-e3eb-447b-80f6-3b4a03ac7e06 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.399795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.400428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.400716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.400996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.401727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:17.402036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.403439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.414646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.415395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.415741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.420483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 310/605] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:17.420618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/bf25e3be640643c1a11fc21e08efdc70/roles/6f8906aa325c40b491f8a8fc312f5139` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.420723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.438375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=bf25e3be640643c1a11fc21e08efdc70, role_id=6f8906aa325c40b491f8a8fc312f5139)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.439826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.454122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 296/606] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:17 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/bf25e3be640643c1a11fc21e08efdc70/roles/6f8906aa325c40b491f8a8fc312f5139 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:50:17.455218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.560111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4da4c-6e1b-4dc2-a0ca-f61b208a09f3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.593149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.597493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180aed6-2d56-4a7f-8085-2c341f987545 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.604862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.605947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.606487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.606995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.607167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.608472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:17.608893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.610689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.622175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 311/607] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:17.623348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.646909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.647950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.648243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.648980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/3e9b1bcc6f8e4bbdacf66021bfe57bbb/roles/6f8906aa325c40b491f8a8fc312f5139` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.666548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=3e9b1bcc6f8e4bbdacf66021bfe57bbb, role_id=6f8906aa325c40b491f8a8fc312f5139)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.668002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.683468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 297/608] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:17 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/3e9b1bcc6f8e4bbdacf66021bfe57bbb/roles/6f8906aa325c40b491f8a8fc312f5139 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:50:17.684442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.745851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb64ac-d5bb-41d8-90eb-2fe0f165dd0d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.784426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.785198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.785489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.785771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.793785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.795543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:17.810638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:17.811600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:17.812482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 312/609] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:17.815603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31095c90-1ba6-43ca-a1f0-d442607b1090 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:17.818612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.863749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:17.864367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:17.864648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:17.864921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:17.879286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:17.881276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:17.892408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:17.898279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:17.899414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:17.900534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:17.900534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:17.900534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:17.900534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:17.902350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 298/610] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:17.906692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:17.920303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:17.966688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cb9ca-4b33-4b44-a962-f84bf8d0beb6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:18.020759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce98ce-89a0-4d00-b4da-7a58f6278731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:18.021678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce98ce-89a0-4d00-b4da-7a58f6278731 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.022115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce98ce-89a0-4d00-b4da-7a58f6278731 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.022610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce98ce-89a0-4d00-b4da-7a58f6278731 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.023527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce98ce-89a0-4d00-b4da-7a58f6278731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:18.023993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce98ce-89a0-4d00-b4da-7a58f6278731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:18.026035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce98ce-89a0-4d00-b4da-7a58f6278731 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:18.031994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d64b-7d98-49ad-970a-55c3d93dc344 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:18.045752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 313/611] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:18.049737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173d94b-4228-4b39-aabb-4913ee1b6257 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.049737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173d94b-4228-4b39-aabb-4913ee1b6257 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.049737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173d94b-4228-4b39-aabb-4913ee1b6257 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.049737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 314/612] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:18.054082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173d94b-4228-4b39-aabb-4913ee1b6257 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:18.077503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c721d-c149-41c4-9253-d3a697076bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:18.078158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c721d-c149-41c4-9253-d3a697076bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.078468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c721d-c149-41c4-9253-d3a697076bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.078744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c721d-c149-41c4-9253-d3a697076bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.079448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c721d-c149-41c4-9253-d3a697076bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:18.079757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c721d-c149-41c4-9253-d3a697076bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:18.081138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c721d-c149-41c4-9253-d3a697076bf6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:18.106090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 299/613] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:18.107776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b38d-5bcd-4673-a061-a32fb52b8249 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.108721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b38d-5bcd-4673-a061-a32fb52b8249 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.110982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b38d-5bcd-4673-a061-a32fb52b8249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.136322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f3c2b38d-5bcd-4673-a061-a32fb52b8249 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:18.139407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f3c2b38d-5bcd-4673-a061-a32fb52b8249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:18.220907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173d94b-4228-4b39-aabb-4913ee1b6257 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:18.222160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:18.231125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 300/614] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:18.232342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b38d-5bcd-4673-a061-a32fb52b8249 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:18.233744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:18.277342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:18.278020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.278324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.278606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/112c65065f6d4c5990f3952e0099cb54/roles/6f8906aa325c40b491f8a8fc312f5139` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.295463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=112c65065f6d4c5990f3952e0099cb54, role_id=6f8906aa325c40b491f8a8fc312f5139)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:18.296910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:18.314641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 315/615] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:18 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/112c65065f6d4c5990f3952e0099cb54/roles/6f8906aa325c40b491f8a8fc312f5139 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:50:18.322432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:18.414558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b38d-5bcd-4673-a061-a32fb52b8249 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:18.459897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a4c3-1f1f-44d9-b29c-110971878528 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:18.502715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:18.503371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.504277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.504616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.505323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:18.506183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.506756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.507209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.516910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:18.522669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:18.523595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:18.524415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 316/616] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:18.525970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:18.527787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:18.530499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:18.547364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:18.548548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:18.549645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:18.551548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 301/617] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:18.554304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:18.557766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:18.666389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf1ef-7852-47f2-87cd-db8077f4a539 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:18.698970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:18.749102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4cbd4-1a9f-4408-a963-5121f2099223 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:18.758233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:18.759042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.759435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.759816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.760655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:18.761068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:18.762576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:18.781652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 317/618] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:18.789046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:18.796967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:18.797608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:18.797891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:18.798164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:18.798992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:18.799297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:18.800761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:18.821026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 302/619] 10.222.0.121 () {56 vars in 1140 bytes} [Mon Aug 1 16:50:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:18.826239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:18.962615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:18.992471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa636d0-1889-49ff-972b-b928601fbcc5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:19.005665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6539b5-b1a3-4499-8b66-40feda255e33 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:19.026302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:19.059500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:19.060157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:19.060443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:19.060722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:19.074858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:19.075523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:19.075812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:19.076086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:19.087769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:19.089341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:19.101672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:19.103179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:19.118681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:19.119956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:19.121120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:19.121120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:19.121120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:19.121120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:19.121120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 303/620] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:19.127280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:19.135757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:19.137981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:19.140114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:19.140114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:19.140114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:19.140114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:19.140114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 318/621] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:19.146778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:19.283763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a967be-b7b7-4204-a51e-8c4c4d426625 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:19.334538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:19.335169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:19.335455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:19.335733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:19.336430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:19.336738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:19.338196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:19.342758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c66fb5-a9cc-4d1a-a076-e95914b92820 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:19.355516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 304/622] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:19.356866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:19.390741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:19.406979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:19.411575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:19.412217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:19.412508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:19.412794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:19.413505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:19.413816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:19.418281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:19.440293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 319/623] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:19.445387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:19.499900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e956e-3783-4152-87cc-d94439d62e3c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:19.539176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:19.554598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:19.554598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:19.554598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:19.558291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:19.559412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:19.578288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:19.579277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:19.580202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:19.580711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 305/624] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:19.583386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:19.674083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23c121-8dc9-41c3-ae8e-4e99cd857801 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:19.747640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:19.748308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:19.748593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:19.748872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:19.763848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:19.765313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:19.774628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:19.787931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:19.790236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:19.792520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 320/625] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:50:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:19.795950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:19.806478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eea9a-7696-4ede-8805-fa064e96993a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:19.871660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:19.872847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:19.873361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:19.874538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:19.875511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:19.876439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:19.888624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:19.914646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:19.919680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 306/626] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:19.927276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:19.986918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55480-bbdd-4e56-83b3-9128bfae032a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:20.052382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2079be-5d3b-4adc-9c2f-193c867fbe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:20.052941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2079be-5d3b-4adc-9c2f-193c867fbe8a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.053226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2079be-5d3b-4adc-9c2f-193c867fbe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.053570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2079be-5d3b-4adc-9c2f-193c867fbe8a None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.054580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2079be-5d3b-4adc-9c2f-193c867fbe8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:20.054896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2079be-5d3b-4adc-9c2f-193c867fbe8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:20.057153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2079be-5d3b-4adc-9c2f-193c867fbe8a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:20.085984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 321/627] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:50:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:20.087536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811704-d340-41d5-be4d-58e02cdbdbfc None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.089112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811704-d340-41d5-be4d-58e02cdbdbfc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.089397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07811704-d340-41d5-be4d-58e02cdbdbfc None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.091028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 322/628] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:20.091757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07811704-d340-41d5-be4d-58e02cdbdbfc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:20.096582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337660b-8fd2-456e-9aff-78e7ca2ef6bd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:20.140543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3358e-ff2f-4f55-86e2-48b15c12680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:20.141498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3358e-ff2f-4f55-86e2-48b15c12680b None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.142120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3358e-ff2f-4f55-86e2-48b15c12680b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.142570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3358e-ff2f-4f55-86e2-48b15c12680b None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fc5b0b0e563f46c693361b1f9bfc66d5/roles/6f8906aa325c40b491f8a8fc312f5139` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.164165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3358e-ff2f-4f55-86e2-48b15c12680b None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=fc5b0b0e563f46c693361b1f9bfc66d5, role_id=6f8906aa325c40b491f8a8fc312f5139)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:20.165840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3358e-ff2f-4f55-86e2-48b15c12680b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:20.178808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:20.184578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 307/629] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:19 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fc5b0b0e563f46c693361b1f9bfc66d5/roles/6f8906aa325c40b491f8a8fc312f5139 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:50:20.186161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df902b-18d6-4e9c-894c-eba56dcbe679 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.186858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df902b-18d6-4e9c-894c-eba56dcbe679 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.187752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df902b-18d6-4e9c-894c-eba56dcbe679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.223950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a7df902b-18d6-4e9c-894c-eba56dcbe679 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:20.225867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a7df902b-18d6-4e9c-894c-eba56dcbe679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:20.253326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07811704-d340-41d5-be4d-58e02cdbdbfc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:20.269842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:20.301556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:20.302659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.303228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.303844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.334291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 308/630] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:20.334291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6924d-1527-4ad8-994a-e7e3dd26333e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.334291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6924d-1527-4ad8-994a-e7e3dd26333e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.334291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6924d-1527-4ad8-994a-e7e3dd26333e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.334291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 309/631] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:20.344047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf51e-83a6-47f9-902b-9f0212150e85 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.344572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf51e-83a6-47f9-902b-9f0212150e85 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.344952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf51e-83a6-47f9-902b-9f0212150e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.373161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4aedf51e-83a6-47f9-902b-9f0212150e85 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:20.374973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4aedf51e-83a6-47f9-902b-9f0212150e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:20.411243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:20.412884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:20.460344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 310/632] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 01 16:50:20.461530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf51e-83a6-47f9-902b-9f0212150e85 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:20.539018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:20.548212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 323/633] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:20.553738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:20.562620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:20.599356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf51e-83a6-47f9-902b-9f0212150e85 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:20.650482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:20.651520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.652008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.652438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.661883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15047-b143-449f-aec8-4ae8d770dec9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:20.666008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:20.671298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:20.672510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:20.673534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:20.680615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 311/634] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:20.681499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:20.704639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a90d1-ae8b-4096-a059-21a2b09f86fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:20.705294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a90d1-ae8b-4096-a059-21a2b09f86fa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.705601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a90d1-ae8b-4096-a059-21a2b09f86fa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.705988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a90d1-ae8b-4096-a059-21a2b09f86fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.721877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a90d1-ae8b-4096-a059-21a2b09f86fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-729a90d1-ae8b-4096-a059-21a2b09f86fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:20.728042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:20.728961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:20.729775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 324/635] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:20.731026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f6f3-5efd-49fb-959b-19477fd18fd3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.731102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f6f3-5efd-49fb-959b-19477fd18fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.731348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f6f3-5efd-49fb-959b-19477fd18fd3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.738344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 325/636] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:20.738344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f6f3-5efd-49fb-959b-19477fd18fd3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:20.807063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7b5d5-c37f-486a-9e19-e4c97d0fcee3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:20.812217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:20.827799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:20.848106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:20.848860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.849297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.849635 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.849865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f6f3-5efd-49fb-959b-19477fd18fd3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:20.861693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:20.863771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:20.881562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:20.882580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:20.883447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:20.883447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:20.883447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:20.883447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:20.887629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 312/637] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:20.888859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:20.897230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1b012-49e5-42dc-b68e-aa0cba670210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:20.897868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1b012-49e5-42dc-b68e-aa0cba670210 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.898229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1b012-49e5-42dc-b68e-aa0cba670210 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.898568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1b012-49e5-42dc-b68e-aa0cba670210 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.899845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1b012-49e5-42dc-b68e-aa0cba670210 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:20.900402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1b012-49e5-42dc-b68e-aa0cba670210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:20.902622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1b012-49e5-42dc-b68e-aa0cba670210 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:20.913904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 326/638] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:20.915198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adc9c2-3579-46db-9b1d-82ecb0174fcd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:20.915710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adc9c2-3579-46db-9b1d-82ecb0174fcd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:20.916199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adc9c2-3579-46db-9b1d-82ecb0174fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:20.938207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-97adc9c2-3579-46db-9b1d-82ecb0174fcd None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:20.939443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-97adc9c2-3579-46db-9b1d-82ecb0174fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:21.016621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549a6ed-beb1-4983-a8fc-eda38af3078f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.034291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 327/639] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:21.034291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adc9c2-3579-46db-9b1d-82ecb0174fcd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.073995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.074838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.075268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.075684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.076772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:21.077098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.078475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.088696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 313/640] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:21.089545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.116267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.129282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.163642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adc9c2-3579-46db-9b1d-82ecb0174fcd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.199845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.200458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.200738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.201011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.201612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922432-0cc8-4509-9f92-77f82ef91a16 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.201715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:21.201985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.203378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.215387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 328/641] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:21.216018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.241106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.241761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.242049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.242364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.253662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.255138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:21.270481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:21.271380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:21.277654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:21.277654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:21.277654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:21.277654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:21.277654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 314/642] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:21.277654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.331468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603f5b1-91fa-4636-a074-2d8ded29ef71 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.360338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.367203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.375729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.376774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.377020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.377283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.386450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a689e-b2af-435a-a98e-edd3c674c8d5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.390311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:21.396190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:21.403617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 329/643] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:21.404752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.439277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.440039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.440397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.440747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.451983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.453514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:21.467897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:21.468785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:21.469814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:21.469814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:21.469814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:21.469814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:21.469814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 315/644] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:21.469814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.523102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc5066-c10d-4135-8dcf-933992774feb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.558142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.558817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.559101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.559384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.566246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.567731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:21.579016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:21.579888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:21.580773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 330/645] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:21.581719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.586998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c627236-808c-44be-add2-9836a05bbde6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.623396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.624025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.624307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.624582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.625271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:21.625576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.626961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.629538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.639231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.642853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 316/646] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:21.643948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.712206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb83e-1f3f-4ef1-a8cd-d409a2dd3fd4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.751892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.752526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.752811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.753085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.753863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:21.754320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.755596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.761063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f2db-7fb5-4c4d-9283-90bcae3174df None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.764471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 331/647] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:21.765376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.806829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.807462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.807743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.808013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.808706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:21.809009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.810409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.828111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 317/648] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:21.828111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:21.895572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9480d-d4be-4ce3-9807-dc3bbb61230a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.897603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.899203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:21.938352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:21.939102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:21.939394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:21.939677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:21.940443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:21.940756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:21.943257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:21.955622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6140e-bbf7-44fc-bc15-133294ec3b21 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:21.958737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 332/649] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:21.959347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.007762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.008429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.008713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.008988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.019437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.020898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:22.032971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:22.034138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:22.035765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 318/650] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:22.036798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.087136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d503555-42f7-4ac5-ae5e-88cbb44649e2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.128146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.128839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.129114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.129570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.141671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.143087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.153431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e06e26-7f52-4454-b616-334bfa1280a0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:22.159342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:22.160817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:22.167133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:22.167133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:22.167133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:22.167133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:22.167133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 333/651] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:22.167133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.176851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:22.185402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:22.200209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.201580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.202337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.203126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.213120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.214818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:22.226894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:22.227969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:22.229166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:22.231206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 319/652] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:22.232211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.278162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc903cc-e9b2-4a46-bf0a-a2069cd33c2f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.317288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.318221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.318530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.318951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.319747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fa3215124493472d89807ab5845258fb) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:22.320056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.321476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.327331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 334/653] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/role_assignments?user.id=fa3215124493472d89807ab5845258fb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 610 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:22.328124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.353669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513bbe5-420a-4198-b924-230ce622d551 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.393237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.393794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.394613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.394891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.395702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:22.396011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.397469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.417964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 320/654] 10.222.0.121 () {56 vars in 1142 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:22.423284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.426183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:22.449508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2d016-8db2-4b53-b8b5-f916525a0148 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.463436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:22.497605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831f2fb-7ae1-40b3-a9dd-9541bedf9b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.497605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831f2fb-7ae1-40b3-a9dd-9541bedf9b6a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.497997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831f2fb-7ae1-40b3-a9dd-9541bedf9b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.498110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831f2fb-7ae1-40b3-a9dd-9541bedf9b6a None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.498841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831f2fb-7ae1-40b3-a9dd-9541bedf9b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:22.499148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831f2fb-7ae1-40b3-a9dd-9541bedf9b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.500518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831f2fb-7ae1-40b3-a9dd-9541bedf9b6a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.515262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 335/655] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:22.516313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126550-9e32-439c-8812-0da0924d5022 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.516602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126550-9e32-439c-8812-0da0924d5022 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.517001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126550-9e32-439c-8812-0da0924d5022 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.520205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 336/656] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:22.520205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab126550-9e32-439c-8812-0da0924d5022 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.564619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5253525-dd02-48ce-80cc-da171fbb49b7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.601565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.602590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.603140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.603600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.604590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:22.605096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.606753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.627238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 321/657] 10.222.0.121 () {56 vars in 1142 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:22.628414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.638380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab126550-9e32-439c-8812-0da0924d5022 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.675505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.676130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.676413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.676688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.687196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:22.731491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:22.741916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9d855-0ae0-43e6-aaca-7f4ee1413e9e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:22.749994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.751898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.783828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40e31-2072-41ea-ae49-91b5a314efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:22.784474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40e31-2072-41ea-ae49-91b5a314efd8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.784757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40e31-2072-41ea-ae49-91b5a314efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.785033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40e31-2072-41ea-ae49-91b5a314efd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.792936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40e31-2072-41ea-ae49-91b5a314efd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:22.794503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40e31-2072-41ea-ae49-91b5a314efd8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9cc40e31-2072-41ea-ae49-91b5a314efd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:22.806184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:22.807301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 16:50:22.808249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:22.812178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 322/658] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:22.813814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a958b5-409c-4e57-b280-f094d1f5fd8e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:22.813957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a958b5-409c-4e57-b280-f094d1f5fd8e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:22.814180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a958b5-409c-4e57-b280-f094d1f5fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:22.833759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a3a958b5-409c-4e57-b280-f094d1f5fd8e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:22.835009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a3a958b5-409c-4e57-b280-f094d1f5fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:22.889011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 337/659] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:22.889960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.924591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 323/660] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:22.925801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a958b5-409c-4e57-b280-f094d1f5fd8e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:22.939304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.009215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16340ce3-acce-4b06-9584-ecd7e382c2b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.023050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.044569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a958b5-409c-4e57-b280-f094d1f5fd8e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.048302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.048934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.049218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.049501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.080340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.080847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.081151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.081410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.083020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:23.083140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.084566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.108740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 324/661] 10.222.0.121 () {56 vars in 1144 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:23.108740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.121825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.123320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.170310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.222195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5913ff4-4cf7-4147-ac38-fafda135c70a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.242688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 338/662] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:23.243712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.262613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.263722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.264171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.264587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.273140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.276303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.278571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:23.293669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:23.294744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:23.295775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:23.295775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:23.295775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:23.295775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:23.297211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 325/663] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:23.298116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.353628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b500b40-9e73-435d-add5-d03077a0f7bb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.389719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.390495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.390855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.391204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.399867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.403167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:23.405999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172decf-bde9-40c4-81f2-11928013fe53 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:23.409048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:23.410648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:23.411469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:23.416997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 339/664] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:23.417856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.451404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.452239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.452525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.452806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.517370 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.529047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.529814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06cf8b-71f3-4b26-95b5-3c5920bd571c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.530571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.565332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.566542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.566822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.567094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.577633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.579104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:23.594794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:23.595674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:23.596550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:23.596550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:23.596550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:23.596550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:23.596550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 340/665] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:23.596818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.642019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 326/666] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:23.642909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.655179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.708067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28abda4-687b-4668-b0b5-02349228b966 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.735104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.745447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b903f81-2eb9-4be8-9ad2-bad4bf48f82f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.747845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.748468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.748751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.749023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.749710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:23.750015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.751415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.772502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 341/667] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:23.772502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.789099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.789809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.790237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.790484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.791211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:23.791523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.792889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.801036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 327/668] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:23.806298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.886481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ad96-8187-42f4-a3aa-91424f977ebe None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.901323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:23.916024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb99d6-653f-44e5-8e13-b870474629a5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:23.924264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.924890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.925205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.925486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.926185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:23.926524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.927895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.940373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 342/669] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:23.941230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.954893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:23.955540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:23.955823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:23.956102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:23.969054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:23.970524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:23.985404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:23.986415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:23.987398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:23.987398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:23.987398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:23.987398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:23.987398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 328/670] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:23.987760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:23.998278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.056686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0aa4-479b-446b-9249-fe072b1f682e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.092752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.093194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3db6f-a9fc-453d-b166-c42b621196fd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.093410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.093701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.094070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.102206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.103682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:24.115188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:24.116120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:24.117052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 343/671] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:24.117573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.132520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.133172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.133448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.133807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.145706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.147209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.151941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:24.162921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:24.164045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:24.164965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:24.164965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:24.164965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:24.164965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:24.164965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 329/672] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:24.165243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.234302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.247155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6436a9-e706-493b-b201-fe2e06048714 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.285904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a275335-0583-48c6-99ff-b8ba99741f5e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.295896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.296652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.296941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.297222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.306596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.308430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:24.323742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:24.324701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:24.325586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 344/673] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:24.329669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.330322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.330832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.331327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.331836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.332802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:24.333643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.337285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.355608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 330/674] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:24.355608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.440855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.450871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf320b-7934-4b70-86e6-de9520c0560a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.456514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be020f-1860-463d-87a7-5502d60fdede None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.475607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.489925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.490578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.490862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.491137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.491883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:24.492195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.493611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.493732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.494232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.494573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.494852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.495712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:24.496394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.497752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.506067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 345/675] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:24.506995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.518419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 331/676] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:24.519366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.624135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883792d0-b738-4a75-a733-29e576e88826 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.627623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5c272-07e3-4a2b-9e02-39c34c25a25b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.658550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa443a-c05b-49fc-9347-2f5eb2aa3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.659171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa443a-c05b-49fc-9347-2f5eb2aa3598 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.659459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa443a-c05b-49fc-9347-2f5eb2aa3598 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.660361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa443a-c05b-49fc-9347-2f5eb2aa3598 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.660647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.661116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa443a-c05b-49fc-9347-2f5eb2aa3598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:24.661293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.661457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa443a-c05b-49fc-9347-2f5eb2aa3598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.661566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.661843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.662881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa443a-c05b-49fc-9347-2f5eb2aa3598 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.668496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.669910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.674412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 346/677] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:24.675696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a4aa7-511e-4570-8248-c067221cfc08 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.676001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a4aa7-511e-4570-8248-c067221cfc08 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.676286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a4aa7-511e-4570-8248-c067221cfc08 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.677790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 347/678] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:24.678531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a4aa7-511e-4570-8248-c067221cfc08 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:24.682140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:24.683036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:24.683917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 332/679] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:24.684755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.694076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.727269 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.782122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a4aa7-511e-4570-8248-c067221cfc08 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.786653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63f3ac-b66c-4733-b929-ad4b30b90af9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.815609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.816352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.816628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.816901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.817682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=bf25e3be640643c1a11fc21e08efdc70) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:24.817994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.819293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3b4d-c7ac-4eab-b56b-53e94f71cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:24.819446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.819938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3b4d-c7ac-4eab-b56b-53e94f71cb94 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.820222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3b4d-c7ac-4eab-b56b-53e94f71cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.820580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3b4d-c7ac-4eab-b56b-53e94f71cb94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.825210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 348/680] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/role_assignments?user.id=bf25e3be640643c1a11fc21e08efdc70&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 610 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:24.825982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.828641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3b4d-c7ac-4eab-b56b-53e94f71cb94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:24.830106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3b4d-c7ac-4eab-b56b-53e94f71cb94 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-236a3b4d-c7ac-4eab-b56b-53e94f71cb94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:24.843808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:24.844971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 333/681] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:24.846029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338c571-76df-4629-be71-ea838fcd3edb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:24.846771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338c571-76df-4629-be71-ea838fcd3edb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:24.846771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338c571-76df-4629-be71-ea838fcd3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:24.866034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6338c571-76df-4629-be71-ea838fcd3edb None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:24.867288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6338c571-76df-4629-be71-ea838fcd3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:24.932589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:24.950611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 334/682] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:24.951385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338c571-76df-4629-be71-ea838fcd3edb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:24.971254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a89e-1f39-4c04-867a-4eca8f754888 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:24.983553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:25.019693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.019693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.019983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.020223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.020966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=3e9b1bcc6f8e4bbdacf66021bfe57bbb) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:25.021292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:25.022758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:25.030245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 349/683] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/role_assignments?user.id=3e9b1bcc6f8e4bbdacf66021bfe57bbb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 610 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:25.034390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.074146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338c571-76df-4629-be71-ea838fcd3edb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:25.130198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.130945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.131225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.131496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.132261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:25.132568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:25.135037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:25.156839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 335/684] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:25.157646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.179395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670e27-15bf-4feb-b609-1e76d3aec0b4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:25.223645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.224275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.224557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.224830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.226067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:25.227638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:25.228351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:25.242218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:25.255822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 350/685] 10.222.0.121 () {56 vars in 1140 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:25.257009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.270152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:25.286726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32402ee0-40de-4fa3-b7fd-165cf4cf5a3d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:25.329667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.330483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.330769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.331041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.346083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:25.353076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:25.354025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:25.354887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:25.355541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 336/686] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:25.356106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.382950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9168261-9d61-4073-8d83-d6eb05166876 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:25.483471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953d3f1-a3a2-4029-a12b-ce021fe8edbb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:25.526863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.527643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.528048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.528332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.541075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.541785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.542133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.542523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.543378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=112c65065f6d4c5990f3952e0099cb54) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:25.543756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:25.545247 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:25.551385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:25.553449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 351/687] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/role_assignments?user.id=112c65065f6d4c5990f3952e0099cb54&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 610 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:25.562905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.618179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:25.620059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:25.723002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:25.747537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 337/688] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:25.753156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.781968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4802d1-75d2-460a-9aa4-6414fb473291 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:25.810656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:25.820642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.821410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.821792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.822171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.823027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:25.823444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:25.824924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:25.836209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 352/689] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:25.841474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.861448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ccf0f-0230-4578-9812-8f8ecb2c52e0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:25.918560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:25.919430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:25.919539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:25.919799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:25.931343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:25.932763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:25.949297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:25.950221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:25.951144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:25.951144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:25.951144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:25.951144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:25.952755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 338/690] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:25.958778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:25.980998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4e4a6-a1c4-4a0e-ba8e-33a1efba2958 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.008211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:26.022237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:26.023244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:26.023793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:26.024689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:26.036036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:26.037755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:26.054136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:26.055211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:26.056182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:26.056182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:26.056182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:26.056182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:26.058553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 353/691] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:26.066924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:26.199373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:26.203134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bf2e1-1ee8-4bc0-9cad-00dfde1e5e5d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.249813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35af8e-7308-442b-b8aa-07af16f14c58 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.265026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:26.265574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:26.265856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:26.266129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:26.266899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:26.267257 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:26.270440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:26.296934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 339/692] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:26.298646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:26.311612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:26.312419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:26.312575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:26.312976 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:26.313709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:26.313863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:26.322282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:26.327726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 354/693] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:26.333200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:26.405555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:26.482839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6355b-80db-4454-b835-d2c4f27d8cea None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.532549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb78be-a434-44b7-86f2-941776b84fb0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.539711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:26.540386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:26.540670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:26.540952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:26.558438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:26.559915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:26.578302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:26.579238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:26.580146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:26.586707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 340/694] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:26.587575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:26.608243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:26.608908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:26.609191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:26.609471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:26.619003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:26.620471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:26.632924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:26.633916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:26.634931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:26.646470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 355/695] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:50:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:26.647188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:26.648116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:26.726179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577ef9b-e99a-44c4-bced-817246ecc323 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.764419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:26.765436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:26.766021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:26.766574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:26.767943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:26.768635 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:26.770305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:26.783869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 341/696] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:26.790662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:26.875039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:26.883758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1cccb-c7c7-428f-ac07-beb9507b4ec4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.950608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:26.952788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:26.953436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:26.953724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:26.954011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:26.954846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:26.955162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:26.956626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:26.989984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3452f9-06a2-4d85-bd39-d9f678bd6393 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:26.995760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 356/697] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:50:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:27.001181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:27.035845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f0fbc-cfaa-47d3-9241-a21324fcb6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:27.036571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0fbc-cfaa-47d3-9241-a21324fcb6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.036867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0fbc-cfaa-47d3-9241-a21324fcb6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.037161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0fbc-cfaa-47d3-9241-a21324fcb6d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.037966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0fbc-cfaa-47d3-9241-a21324fcb6d1 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fc5b0b0e563f46c693361b1f9bfc66d5) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:27.038302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0fbc-cfaa-47d3-9241-a21324fcb6d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:27.039880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0fbc-cfaa-47d3-9241-a21324fcb6d1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:27.047251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 342/698] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:26 2022] GET /identity/v3/role_assignments?user.id=fc5b0b0e563f46c693361b1f9bfc66d5&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 610 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:27.145495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e2832-b45d-4ac5-b63e-89f0fc4056bb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:27.185319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:27.186015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.186326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.186611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.218659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:27.248053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9527cab-8d89-439b-9439-ccd8b257819d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.248367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9527cab-8d89-439b-9439-ccd8b257819d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.248618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9527cab-8d89-439b-9439-ccd8b257819d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.250241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 343/699] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:50:27.256073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133a997-09ae-484c-b2f0-afaaa8d2ce2c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.256321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133a997-09ae-484c-b2f0-afaaa8d2ce2c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.256560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133a997-09ae-484c-b2f0-afaaa8d2ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.280534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:27.282397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:27.286103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6133a997-09ae-484c-b2f0-afaaa8d2ce2c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:27.286810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6133a997-09ae-484c-b2f0-afaaa8d2ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:27.360755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 344/700] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:50:27.384472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133a997-09ae-484c-b2f0-afaaa8d2ce2c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:27.398902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 357/701] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:27.404500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:27.469626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:27.479544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:27.512270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133a997-09ae-484c-b2f0-afaaa8d2ce2c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:27.531439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f58b9-c8fe-4f84-bb79-ca1340e9af19 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:27.553446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd6580-0eb8-4232-820c-671b55036422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:27.554025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6580-0eb8-4232-820c-671b55036422 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.554352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6580-0eb8-4232-820c-671b55036422 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.554697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd6580-0eb8-4232-820c-671b55036422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.568496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd6580-0eb8-4232-820c-671b55036422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:27.570478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd6580-0eb8-4232-820c-671b55036422 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:27.573450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc425c6-ad83-4c11-bc82-c85acff32304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:27.574187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc425c6-ad83-4c11-bc82-c85acff32304 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.574575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc425c6-ad83-4c11-bc82-c85acff32304 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.574929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc425c6-ad83-4c11-bc82-c85acff32304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.586503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc425c6-ad83-4c11-bc82-c85acff32304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:27.588063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc425c6-ad83-4c11-bc82-c85acff32304 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f5dd6580-0eb8-4232-820c-671b55036422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:27.590500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:27.591634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:27.592689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:27.592689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:27.592689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:27.592689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:27.599981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 345/702] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:27.602221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8986-88e2-40b2-8f90-6e775427bc82 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.602692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8986-88e2-40b2-8f90-6e775427bc82 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.603404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f8986-88e2-40b2-8f90-6e775427bc82 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.605434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 346/703] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:27.606354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f8986-88e2-40b2-8f90-6e775427bc82 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-edc425c6-ad83-4c11-bc82-c85acff32304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:27.613453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:27.614589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:27.616101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:27.616101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:27.616101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:27.616101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:27.616101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 358/704] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:27.616384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40706819-be5d-4e67-a29a-fbd74091d877 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.616640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40706819-be5d-4e67-a29a-fbd74091d877 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.616924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40706819-be5d-4e67-a29a-fbd74091d877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.639699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-40706819-be5d-4e67-a29a-fbd74091d877 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:27.640922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-40706819-be5d-4e67-a29a-fbd74091d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:27.728539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 359/705] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:27.729834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40706819-be5d-4e67-a29a-fbd74091d877 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:27.742738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f8986-88e2-40b2-8f90-6e775427bc82 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:27.775124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:27.786553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:27.791490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:27.793735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.794228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.794741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.796092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:27.796606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:27.798647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:27.812476 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 347/706] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:27.813367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:27.874450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40706819-be5d-4e67-a29a-fbd74091d877 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:27.914824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:27.915449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.915729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.916010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.916712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:27.917119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:27.918650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:27.931497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334898-8cab-4765-a471-741593f3b0f0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:27.931823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 360/707] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:27.932654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:27.972826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:27.973532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:27.973820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:27.974098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:27.974764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:27.976213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:27.987504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:27.988503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:27.989819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:27.998291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 348/708] 10.222.0.121 () {56 vars in 1134 bytes} [Mon Aug 1 16:50:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:27.998291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:28.049353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:28.061902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:28.071734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274eefb-2482-420a-aa1c-e996c7c35378 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.106506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72afff1-fa1c-4830-8c5b-4f68acc44800 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.112190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.113563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.114144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.114456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.115141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:28.116698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:28.142441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 361/709] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:50:27 2022] POST /identity/v3/users => generated 255 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:28.142441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:28.144379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce60fe0-ee8c-4430-950f-648185b0f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.145299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce60fe0-ee8c-4430-950f-648185b0f123 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.145592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce60fe0-ee8c-4430-950f-648185b0f123 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.145876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce60fe0-ee8c-4430-950f-648185b0f123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.163201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce60fe0-ee8c-4430-950f-648185b0f123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:28.165709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce60fe0-ee8c-4430-950f-648185b0f123 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4ce60fe0-ee8c-4430-950f-648185b0f123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:28.184228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:28.185430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:28.186643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:28.190475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 349/710] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:28.191971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ace59-3cca-43e3-9083-fbacb9e0a6f2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.192245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ace59-3cca-43e3-9083-fbacb9e0a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.192522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ace59-3cca-43e3-9083-fbacb9e0a6f2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.198506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 350/711] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:28 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:28.199475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ace59-3cca-43e3-9083-fbacb9e0a6f2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:28.274626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63d672-e2d5-40f5-abd7-46d2c6f2211e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.311302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ace59-3cca-43e3-9083-fbacb9e0a6f2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.313793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d53983-a956-4bd5-b03a-91f0a06f6e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.314669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53983-a956-4bd5-b03a-91f0a06f6e54 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.315100 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53983-a956-4bd5-b03a-91f0a06f6e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.315523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d53983-a956-4bd5-b03a-91f0a06f6e54 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.316900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53983-a956-4bd5-b03a-91f0a06f6e54 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:28.317210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53983-a956-4bd5-b03a-91f0a06f6e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:28.318657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d53983-a956-4bd5-b03a-91f0a06f6e54 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:28.323114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:28.326801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 362/712] 10.222.0.121 () {56 vars in 1129 bytes} [Mon Aug 1 16:50:28 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:28.328642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6869d-e429-4691-8f29-8b137425112b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.329166 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6869d-e429-4691-8f29-8b137425112b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.329771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6869d-e429-4691-8f29-8b137425112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.351051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-08b6869d-e429-4691-8f29-8b137425112b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:28.352573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-08b6869d-e429-4691-8f29-8b137425112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:28.353604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.354146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.354557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.354725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.355467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:28.355771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:28.357194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:28.364903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:28.374126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 351/713] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:28.379738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:28.440662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 363/714] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:28.442183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6869d-e429-4691-8f29-8b137425112b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:28.517299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46a196-ed59-4ba4-aa27-302b8b94e128 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.564275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.564898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.565177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.565449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.566699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:28.567001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:28.568381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:28.576394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 352/715] 10.222.0.121 () {56 vars in 1129 bytes} [Mon Aug 1 16:50:28 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:28.577794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:28.583206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6869d-e429-4691-8f29-8b137425112b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.633591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.636159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.636450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.636732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.637560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fa3215124493472d89807ab5845258fb) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:28.638127 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:28.639724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:28.648054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 364/716] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:28 2022] GET /identity/v3/role_assignments?user.id=fa3215124493472d89807ab5845258fb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:28.687417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:28.777216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37710d51-77f8-45e8-8f3d-f5382e82d28f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.814083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.814793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.815075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.815350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] PATH_INFO: `/v3/services/network` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.816589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:28.817980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:28.828817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:28.829906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:28.830810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 353/717] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:28 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:28.838325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:28.853214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:28.959286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d592c09-d6b9-4cb5-afbf-b555351431ba None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:28.996248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaaeba-eb8f-436f-b760-bf60b7b984ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:28.997264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaaeba-eb8f-436f-b760-bf60b7b984ab None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:28.997752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaaeba-eb8f-436f-b760-bf60b7b984ab None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:28.998310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaaeba-eb8f-436f-b760-bf60b7b984ab None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:28.999222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaaeba-eb8f-436f-b760-bf60b7b984ab None admin] RBAC: Adding query filter params (name=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:28.999750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaaeba-eb8f-436f-b760-bf60b7b984ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:29.001433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaaeba-eb8f-436f-b760-bf60b7b984ab None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:29.007832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 365/718] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:28 2022] GET /identity/v3/services?name=network => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:29.014002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:29.153334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:29.160971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91ae08-5c5c-4256-8220-65c7dd7a6260 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:29.209341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630be49-2d48-4824-aa6b-ddc30723cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:29.209977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630be49-2d48-4824-aa6b-ddc30723cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:29.210274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630be49-2d48-4824-aa6b-ddc30723cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:29.210566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630be49-2d48-4824-aa6b-ddc30723cdb7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:29.211254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630be49-2d48-4824-aa6b-ddc30723cdb7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:29.211561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630be49-2d48-4824-aa6b-ddc30723cdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:29.212929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630be49-2d48-4824-aa6b-ddc30723cdb7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:29.217776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 354/719] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:29 2022] GET /identity/v3/services?type=network => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:29.581611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e6a82-2d3f-4437-9163-90f0f55179fe None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:29.582313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e6a82-2d3f-4437-9163-90f0f55179fe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:29.582823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e6a82-2d3f-4437-9163-90f0f55179fe None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:29.584661 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 366/720] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:29.589793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12441b8c-2337-4a03-ad71-0cd2a6a70501 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:29.590282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12441b8c-2337-4a03-ad71-0cd2a6a70501 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:29.590391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12441b8c-2337-4a03-ad71-0cd2a6a70501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:29.614538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-12441b8c-2337-4a03-ad71-0cd2a6a70501 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:29.615736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-12441b8c-2337-4a03-ad71-0cd2a6a70501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:29.695471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 355/721] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:29.729105 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e6a82-2d3f-4437-9163-90f0f55179fe None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:29.840574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:29.872581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e6a82-2d3f-4437-9163-90f0f55179fe None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:29.917805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:29.918763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:29.919207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:29.919625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:29.930997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:29.936092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:29.937200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:29.944760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 367/722] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:29.947183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12441b8c-2337-4a03-ad71-0cd2a6a70501 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:30.075854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:30.084954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12441b8c-2337-4a03-ad71-0cd2a6a70501 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:30.119807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:30.120357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:30.120696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:30.120969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:30.121732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:30.122037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:30.123449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:30.132744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 356/723] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:30.138045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:30.294786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c363b-7a16-433b-ae22-396daed946ae None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:30.345394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec603b-970b-43d2-b9fe-c544e4f2e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:30.346473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec603b-970b-43d2-b9fe-c544e4f2e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:30.347041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec603b-970b-43d2-b9fe-c544e4f2e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:30.347520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec603b-970b-43d2-b9fe-c544e4f2e5f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:30.355933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:30.365994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec603b-970b-43d2-b9fe-c544e4f2e5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:30.367748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec603b-970b-43d2-b9fe-c544e4f2e5f6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ccec603b-970b-43d2-b9fe-c544e4f2e5f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:30.390846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:30.391820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:30.392699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:30.392699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:30.392699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:30.392699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:30.392699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 368/724] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:30.402341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:30.511514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54efb-7e7e-4571-8932-6344f9e7df34 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:30.511830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54efb-7e7e-4571-8932-6344f9e7df34 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:30.512085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54efb-7e7e-4571-8932-6344f9e7df34 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:30.513953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 369/725] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:30.519587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494edb38-090d-40f3-9e07-11bb9c9c605d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:30.519881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494edb38-090d-40f3-9e07-11bb9c9c605d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:30.520163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494edb38-090d-40f3-9e07-11bb9c9c605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:30.528865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffc2dd-8cd6-4f60-966e-0ee6f20e96b0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:30.555978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-494edb38-090d-40f3-9e07-11bb9c9c605d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:30.557163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-494edb38-090d-40f3-9e07-11bb9c9c605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:30.607568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:30.608263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:30.608491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:30.608771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:30.609479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:30.609789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:30.611191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:30.636098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 357/726] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:30.642825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:30.654370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 370/727] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 16:50:30.666350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:30.694024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494edb38-090d-40f3-9e07-11bb9c9c605d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:30.777364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ea44e-7e3c-4238-ab97-1f67c3ea59af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:30.839075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:30.845722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:30.846340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:30.846873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:30.861708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:30.864827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:30.886430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:30.887423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:30.888610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:30.897334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 358/728] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:30.903978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494edb38-090d-40f3-9e07-11bb9c9c605d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:30.905071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:30.941572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:30.961740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:30.962700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:30.963138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:30.963585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:30.975030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:30.980132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:30.981260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:30.982317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:30.984526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 371/729] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:30.990813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.042729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.060745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424970ee-95b5-45b8-b54d-7fb19f841f92 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.096166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.097462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.097898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.098284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.099246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:31.099730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.101268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.119920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 359/730] 10.222.0.121 () {56 vars in 1140 bytes} [Mon Aug 1 16:50:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:31.125340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.209004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fff609-0da1-4453-ad86-f0e0ccde1f66 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.228454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca338db3-c8dd-48a4-9a9c-63687d9fb045 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.254917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d842c62-2f3c-4214-bb8e-c6d19a6f63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.255621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d842c62-2f3c-4214-bb8e-c6d19a6f63e0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.255912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d842c62-2f3c-4214-bb8e-c6d19a6f63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.256189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d842c62-2f3c-4214-bb8e-c6d19a6f63e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.257108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d842c62-2f3c-4214-bb8e-c6d19a6f63e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:31.257322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d842c62-2f3c-4214-bb8e-c6d19a6f63e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.258737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d842c62-2f3c-4214-bb8e-c6d19a6f63e0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.264494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.270854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 372/731] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:30 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:31.272382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6b20-48a8-4177-bae2-acc52baab5ef None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.272842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6b20-48a8-4177-bae2-acc52baab5ef None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.273185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c999-1430-4398-9262-475772ed9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.273450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6b20-48a8-4177-bae2-acc52baab5ef None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.274016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c999-1430-4398-9262-475772ed9dca None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.274513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c999-1430-4398-9262-475772ed9dca None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.275040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c999-1430-4398-9262-475772ed9dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.279867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 373/732] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:31.280890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b6b20-48a8-4177-bae2-acc52baab5ef None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.323974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.360720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c999-1430-4398-9262-475772ed9dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.363243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c999-1430-4398-9262-475772ed9dca None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.405217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b6b20-48a8-4177-bae2-acc52baab5ef None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.444360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acf1f2-785f-4ce7-845e-797268095f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.445015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acf1f2-785f-4ce7-845e-797268095f0c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.445488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acf1f2-785f-4ce7-845e-797268095f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.445752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acf1f2-785f-4ce7-845e-797268095f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.456554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acf1f2-785f-4ce7-845e-797268095f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.457989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acf1f2-785f-4ce7-845e-797268095f0c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a2acf1f2-785f-4ce7-845e-797268095f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:31.472253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:31.473135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:31.474006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:31.474006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:31.474006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:31.474006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:31.474006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 374/733] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:31.474644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde5d72-3cd5-4b87-b6fd-8a4b10f5b738 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.474843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde5d72-3cd5-4b87-b6fd-8a4b10f5b738 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.475174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde5d72-3cd5-4b87-b6fd-8a4b10f5b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.491105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 360/734] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:31.492762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f3cd2-0398-42ef-801b-aee471a5b1e3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.493219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f3cd2-0398-42ef-801b-aee471a5b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.493511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2dde5d72-3cd5-4b87-b6fd-8a4b10f5b738 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:31.493870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f3cd2-0398-42ef-801b-aee471a5b1e3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.494797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2dde5d72-3cd5-4b87-b6fd-8a4b10f5b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:31.495948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 361/735] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:31.496970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f3cd2-0398-42ef-801b-aee471a5b1e3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.529691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.570456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 375/736] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:31.571310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde5d72-3cd5-4b87-b6fd-8a4b10f5b738 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.593797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.609584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f3cd2-0398-42ef-801b-aee471a5b1e3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.652601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb628e-2be5-401d-85cc-bc22495bd8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.653231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb628e-2be5-401d-85cc-bc22495bd8ab None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.653510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb628e-2be5-401d-85cc-bc22495bd8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.653785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb628e-2be5-401d-85cc-bc22495bd8ab None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.654497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb628e-2be5-401d-85cc-bc22495bd8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:31.654805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb628e-2be5-401d-85cc-bc22495bd8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.656164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb628e-2be5-401d-85cc-bc22495bd8ab None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.668178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 362/737] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:31.674073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4cdee-9340-47d4-a402-780fe6039fac None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.674379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4cdee-9340-47d4-a402-780fe6039fac None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.674666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4cdee-9340-47d4-a402-780fe6039fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.676493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde5d72-3cd5-4b87-b6fd-8a4b10f5b738 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.692661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-18e4cdee-9340-47d4-a402-780fe6039fac None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:31.693857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18e4cdee-9340-47d4-a402-780fe6039fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:31.712630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.713594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.713882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.714163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.725714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.727139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:31.743991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:31.744917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:31.745803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:31.745803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:31.745803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:31.745803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:31.745803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 376/738] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:31.746084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.778292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 363/739] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:31.778292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4cdee-9340-47d4-a402-780fe6039fac None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.805219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.840189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.872067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f327-95d5-4db5-8bbe-7b2e6a6e751f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.883100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4cdee-9340-47d4-a402-780fe6039fac None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:31.907356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.907981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.908260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.908533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.909698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.911086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.918282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:31.918939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:31.919243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:31.919504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:31.927337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 377/740] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:50:31 2022] POST /identity/v3/services => generated 252 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:31.927482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:31.928153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:31.928872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:31.950391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:31.951428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:31.952395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 364/741] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:50:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:31.952988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.049711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.067688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929604-3eea-4f47-bf73-ae03b5bdccca None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.071067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd8c9f-9f96-45a3-b774-039ca658d640 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.104343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.112044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0696a-e635-4a88-8633-91f2a9eb68e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.113310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0696a-e635-4a88-8633-91f2a9eb68e7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.113589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0696a-e635-4a88-8633-91f2a9eb68e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.113860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0696a-e635-4a88-8633-91f2a9eb68e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.115861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.116482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.116762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.117196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.117833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:32.118137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.119577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.124926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0696a-e635-4a88-8633-91f2a9eb68e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ece0696a-e635-4a88-8633-91f2a9eb68e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:32.130483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:32.131481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:32.132328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 365/742] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:32.133020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1cdbd-c8fd-499f-8cf6-293ad41a6749 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.133095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1cdbd-c8fd-499f-8cf6-293ad41a6749 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.133683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1cdbd-c8fd-499f-8cf6-293ad41a6749 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.136630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 366/743] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:32.136762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 378/744] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:32.136846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1cdbd-c8fd-499f-8cf6-293ad41a6749 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.137532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.247704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3378-bd1d-4ec2-a73b-d037041a23fa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.253097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1cdbd-c8fd-499f-8cf6-293ad41a6749 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.286872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.287494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.287772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.288044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.288615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b595c0-7779-4656-b831-c8210fd0d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.288836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:32.289182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.289290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b595c0-7779-4656-b831-c8210fd0d444 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.289563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b595c0-7779-4656-b831-c8210fd0d444 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.289839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b595c0-7779-4656-b831-c8210fd0d444 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.290560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.290670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b595c0-7779-4656-b831-c8210fd0d444 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:32.290956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b595c0-7779-4656-b831-c8210fd0d444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.292364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b595c0-7779-4656-b831-c8210fd0d444 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.305837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 379/745] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:32.305837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.308107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.314356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 367/746] 10.222.0.121 () {56 vars in 1154 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:32.316576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611a54-ba49-42ea-bd9d-6c2a573f4c82 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.317038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611a54-ba49-42ea-bd9d-6c2a573f4c82 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.317511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611a54-ba49-42ea-bd9d-6c2a573f4c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.336241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9c611a54-ba49-42ea-bd9d-6c2a573f4c82 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:32.337430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c611a54-ba49-42ea-bd9d-6c2a573f4c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:32.361264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.411463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 368/747] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:32 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:32.411463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c611a54-ba49-42ea-bd9d-6c2a573f4c82 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.422293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f21ee-c2e9-4724-9795-396df1fa6557 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.458181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.458855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.459137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.459409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.466499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.467942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:32.479932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:32.481009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:32.482190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:32.485807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 380/748] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:32.486672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.532080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c611a54-ba49-42ea-bd9d-6c2a573f4c82 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.562845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.569362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.570010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.570425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.570701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.581261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.582732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.598795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c67f19-3bb2-4380-b780-38d30e5a3efd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:32.599103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:32.599932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:32.600819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:32.600819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:32.600819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:32.600819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:32.600819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 369/749] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:32.601094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.624506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.651983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.653132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.653639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.654149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.710380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedac7b7-9aa9-47a3-b7f5-e80f9e1ac93a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.741206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.742704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.745481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.746104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.746417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.746693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.747372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.748707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.765579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 370/750] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:50:32 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:32.766544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.819643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.906903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 381/751] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:32.909046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:32.913795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f4289-aa88-4065-ae16-569b9a20d1b2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:32.927800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:32.954835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:32.955608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:32.955897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:32.956201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:32.956955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:32.957294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:32.958768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:32.973109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 371/752] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:32.974345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.038634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724c7fc-1783-47e1-b20f-a53f9f153922 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.084840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.085395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.085684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.085965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.086700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:33.087010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.088497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.102937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 382/753] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:33.107400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:33.108205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704096bf-733d-4c94-8d40-0353609a0d55 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.108744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.155066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.155731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.156021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.156303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.171075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.172814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.188334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:33.195336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:33.196252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:33.197122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:33.197122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:33.197122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:33.197122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:33.201655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 372/754] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:33.202647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.230115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228691-611e-441d-95d7-ae0cfe73d94d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.277264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.277925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.278172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.278484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.279455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fc5b0b0e563f46c693361b1f9bfc66d5) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:33.279773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.281835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.294303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 383/755] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/role_assignments?user.id=fc5b0b0e563f46c693361b1f9bfc66d5&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:33.294303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.361285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc584d3-7135-408f-bd71-0ea194345fd7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.439933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.442795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae521c1a-4717-4850-bafe-ab618554c0b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.443768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.444277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.444796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.465429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.467323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:33.490186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:33.491288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:33.492249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:33.500781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 373/756] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:33.510029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.520293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.520810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.521099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.521381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.522094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:33.522437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.523837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.525555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:33.530596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:33.539947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 384/757] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:33.545512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.651990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db005978-51e0-4e7f-9884-85cdf6c33dca None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.655292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c0971-3aff-4b1a-8cda-471768c3026a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.698766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.699420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.699708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.699985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.713132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.713766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.714053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.714357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.715169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:33.715482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.716693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.718132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.719507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:33.738713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:33.739659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:33.740563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 385/758] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:33.748538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.754787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 374/759] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:33.761706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.841818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:33.889939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b04cc-72c8-4049-925a-ed73de9bf9e1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:33.927994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:33.934383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:33.935457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:33.935961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:33.936634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:33.937599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:33.938111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:33.939829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:33.968192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 386/760] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:33.974675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:33.979155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d17bc-4984-4ca0-96ca-c802ed0d0c54 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:34.108736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54e169-6743-4ff1-84cb-de134fca82e5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:34.124925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:34.136758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:34.137416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.137956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.138231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.148731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd4254-c789-48f9-9c63-d70c9a908939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:34.148896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:34.149714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4254-c789-48f9-9c63-d70c9a908939 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.150182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4254-c789-48f9-9c63-d70c9a908939 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.150323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:34.150792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd4254-c789-48f9-9c63-d70c9a908939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.151723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd4254-c789-48f9-9c63-d70c9a908939 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=1037da4d8e26461abaed2fb3fce7e81d) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:34.152226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd4254-c789-48f9-9c63-d70c9a908939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:34.153790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd4254-c789-48f9-9c63-d70c9a908939 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:34.160602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 387/761] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/role_assignments?user.id=1037da4d8e26461abaed2fb3fce7e81d&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:34.162045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0582ae-274d-4f8a-b029-79a71fb4dbc5 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.162462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0582ae-274d-4f8a-b029-79a71fb4dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.162784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0582ae-274d-4f8a-b029-79a71fb4dbc5 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.164566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 388/762] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:34.167617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:34.168494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:34.169416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:34.169416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:34.169416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:34.169416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:34.169648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3ae0c-6325-4742-b6ee-d72b88bc50e4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.169801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3ae0c-6325-4742-b6ee-d72b88bc50e4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.170079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3ae0c-6325-4742-b6ee-d72b88bc50e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.171586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 375/763] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:34.183103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:34.215857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-92e3ae0c-6325-4742-b6ee-d72b88bc50e4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:34.217084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-92e3ae0c-6325-4742-b6ee-d72b88bc50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:34.336812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 389/764] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:34 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:34.375429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3ae0c-6325-4742-b6ee-d72b88bc50e4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:34.390988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244499-799b-4b38-9e01-05a25d6110c9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:34.414135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:34.436074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:34.436623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.436900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.437170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.437849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:34.438149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:34.439530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:34.466093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 376/765] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:34.472752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:34.554671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3ae0c-6325-4742-b6ee-d72b88bc50e4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:34.564506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:34.596704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:34.597858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.598136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.598432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.599066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:34.600435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:34.618792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:34.619757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:34.620610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 390/766] 10.222.0.121 () {56 vars in 1134 bytes} [Mon Aug 1 16:50:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:34.634607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:34.662136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633d1ed-acb3-4263-b276-1de4a9a72ba9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:34.707767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:34.708973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.709259 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.709537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.716977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:34.718549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:34.730325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:34.731245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:34.732142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 377/767] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:34.737283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:34.780456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:34.841893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2dc3c-5bd6-4c76-b554-640e3dc06137 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:34.846086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484ec6-abec-4407-a40f-ecb74f0af15b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:34.876146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:34.876779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.877060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.877337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.878641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:34.878954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:34.880439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:34.894188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 378/768] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:34.900018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:34.933378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c437d62-4917-4df6-87d0-3c3d8d2dafd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:34.934542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c437d62-4917-4df6-87d0-3c3d8d2dafd4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.935106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c437d62-4917-4df6-87d0-3c3d8d2dafd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.935594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c437d62-4917-4df6-87d0-3c3d8d2dafd4 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.936487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c437d62-4917-4df6-87d0-3c3d8d2dafd4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:34.937002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c437d62-4917-4df6-87d0-3c3d8d2dafd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:34.938680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c437d62-4917-4df6-87d0-3c3d8d2dafd4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:34.950810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 391/769] 10.222.0.121 () {56 vars in 1129 bytes} [Mon Aug 1 16:50:34 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:34.959343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8fae-38f2-4b2c-a93c-78557f223629 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:34.959879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8fae-38f2-4b2c-a93c-78557f223629 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:34.960459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db8fae-38f2-4b2c-a93c-78557f223629 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:34.962423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 392/770] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:50:34.963479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db8fae-38f2-4b2c-a93c-78557f223629 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:35.002880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:35.005882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aebc5e-d519-4327-a1ed-f3aacdea1569 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:35.008701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:35.043020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8f403-e388-4ba7-b609-cedf0755efe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:35.044080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8f403-e388-4ba7-b609-cedf0755efe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.044565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8f403-e388-4ba7-b609-cedf0755efe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.045040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8f403-e388-4ba7-b609-cedf0755efe0 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fa3215124493472d89807ab5845258fb/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.047261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8f403-e388-4ba7-b609-cedf0755efe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=fa3215124493472d89807ab5845258fb, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:35.048883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8f403-e388-4ba7-b609-cedf0755efe0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:35.072102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 379/771] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:34 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fa3215124493472d89807ab5845258fb/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:50:35.078744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca218-b97e-4a94-a5a3-03456b5c025c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.078744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca218-b97e-4a94-a5a3-03456b5c025c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.078744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca218-b97e-4a94-a5a3-03456b5c025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.114203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db8fae-38f2-4b2c-a93c-78557f223629 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:35.117217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b21ca218-b97e-4a94-a5a3-03456b5c025c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:35.119532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b21ca218-b97e-4a94-a5a3-03456b5c025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:35.183432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:35.184277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.185203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.185484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.186179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:35.187040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:35.189014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:35.206491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 393/772] 10.222.0.121 () {56 vars in 1129 bytes} [Mon Aug 1 16:50:34 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:35.211660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:35.258994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 380/773] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:35.287894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ca218-b97e-4a94-a5a3-03456b5c025c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:35.346086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:35.349603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50f0b8-e98e-4be7-9bf7-8c2be75efb49 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:35.386577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:35.387347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.387950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.388293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.389134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] RBAC: Adding query filter params (interface=public, service_id=d2e4ccccb1d14605bb115beda8b4d3ab, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:35.389515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:35.390980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:35.406801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 394/774] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:50:35 2022] GET /identity/v3/endpoints?service_id=d2e4ccccb1d14605bb115beda8b4d3ab&interface=public®ion_id=RegionOne => generated 195 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:35.406801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:35.417077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:35.426979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ca218-b97e-4a94-a5a3-03456b5c025c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:35.476750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:35.477673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.478125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.478564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] PATH_INFO: `/v3/services/network` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.479453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:35.480976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:35.496034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:35.497298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:35.498414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:35.502233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 381/775] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:35 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:35.512474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:35.590984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bc1d1-d745-4b15-b32e-6d5d0017aa0f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:35.661746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:35.662757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.663214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.663639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.664487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:35.667123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:35.680801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 395/776] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:50:35 2022] GET /identity/v3/services => generated 776 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:35.699556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5641e-6ac1-48b3-85b7-00d1314cd538 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:35.750187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2609aa-a44f-433a-9361-e6d78a78a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:35.750846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2609aa-a44f-433a-9361-e6d78a78a429 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.751045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2609aa-a44f-433a-9361-e6d78a78a429 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.751320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2609aa-a44f-433a-9361-e6d78a78a429 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.752090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2609aa-a44f-433a-9361-e6d78a78a429 None admin] RBAC: Adding query filter params (name=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:35.752396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2609aa-a44f-433a-9361-e6d78a78a429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:35.754419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2609aa-a44f-433a-9361-e6d78a78a429 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:35.764460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 382/777] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:35 2022] GET /identity/v3/services?name=network => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:35.765911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:35.823560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:35.922675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1012-d864-40af-a83d-9a2e1d877160 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.923196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1012-d864-40af-a83d-9a2e1d877160 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.923621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1012-d864-40af-a83d-9a2e1d877160 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.927052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 383/778] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:35 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:35.931211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87e97-7350-46a8-b9c6-7a93220107f6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.931500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87e97-7350-46a8-b9c6-7a93220107f6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.931781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b87e97-7350-46a8-b9c6-7a93220107f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.937143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8cc50-705b-4055-b28b-5c5de8c3384e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:35.952409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-09b87e97-7350-46a8-b9c6-7a93220107f6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:35.953995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-09b87e97-7350-46a8-b9c6-7a93220107f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:35.969761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:35.977228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:35.977883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:35.978231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:35.978742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:35.979973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] RBAC: Adding query filter params (type=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:35.980332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:35.981962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:35.988625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 396/779] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:35 2022] GET /identity/v3/services?type=network => generated 352 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:35.994691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:36.068604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 384/780] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:35 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:36.091038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87e97-7350-46a8-b9c6-7a93220107f6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:36.115599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:36.126891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84fc91-4c0a-4410-868e-65cb159ec605 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:36.201466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:36.202106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.202417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.202698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.203564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] RBAC: Adding query filter params (interface=public, service_id=8d561cffc62e416faadf2b5a3526c68d, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:36.203883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:36.205381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:36.219790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 397/781] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:50:35 2022] GET /identity/v3/endpoints?service_id=8d561cffc62e416faadf2b5a3526c68d&interface=public®ion_id=RegionOne => generated 195 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:36.225862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:36.229345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b87e97-7350-46a8-b9c6-7a93220107f6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:36.275245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:36.275912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.276196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.276470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.296107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:36.301065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:36.301985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:36.302880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 385/782] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:36.315762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:36.336381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:36.385875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ccfa-1802-4d96-a5a6-a93cccce7894 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:36.445739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:36.446406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.446694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.447030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.447702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:36.449075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:36.465266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 398/783] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:50:36 2022] GET /identity/v3/services => generated 776 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:36.476848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521e1d4-95a9-4ddf-aa29-1aaa61cebf5d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:36.516703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa8919-84dc-4f43-9eb3-f360816a80cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:36.517347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa8919-84dc-4f43-9eb3-f360816a80cf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.517625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa8919-84dc-4f43-9eb3-f360816a80cf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.517897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa8919-84dc-4f43-9eb3-f360816a80cf None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.518705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa8919-84dc-4f43-9eb3-f360816a80cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:36.519012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa8919-84dc-4f43-9eb3-f360816a80cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:36.520414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa8919-84dc-4f43-9eb3-f360816a80cf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:36.530371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 386/784] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:36 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:36.536233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:36.585579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:36.589007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0aa4-52ba-480c-bc59-f0a2e981e606 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.589305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0aa4-52ba-480c-bc59-f0a2e981e606 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.589651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b0aa4-52ba-480c-bc59-f0a2e981e606 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.592034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 387/785] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:50:36.598946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41f06-6991-485a-a562-8e753dc8a401 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.599317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41f06-6991-485a-a562-8e753dc8a401 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.599665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee41f06-6991-485a-a562-8e753dc8a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.627817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1ee41f06-6991-485a-a562-8e753dc8a401 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:36.629341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ee41f06-6991-485a-a562-8e753dc8a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:36.723886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064b27a-5fdd-451c-b8be-97fa7da15e8b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:36.729209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:36.730895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 388/786] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:36 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:36.762234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee41f06-6991-485a-a562-8e753dc8a401 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:36.763159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:36.763506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.763785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.764057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.778847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:36.780288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:36.799242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:36.800189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:36.801065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:36.801065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:36.801065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:36.801065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:36.801065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 399/787] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:36.807080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:36.887940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:36.936758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee966bc-5402-4759-a756-99b6056261eb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:36.948188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee41f06-6991-485a-a562-8e753dc8a401 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:36.985911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:36.986917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:36.987914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:36.989459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:36.991749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:36.992264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:36.994573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:37.011995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:37.014805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.015245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.015693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.024907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 400/788] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:37.030547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.041593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:37.049211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:37.050902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:37.051729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:37.054111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 389/789] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:37.060237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.126878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:37.168540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44fda8-686d-4c88-be1c-2408adfd6111 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:37.208316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:37.209243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.209681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.210176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.211290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:37.211756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:37.213674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:37.223995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 390/790] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:37.229703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.260291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dafdd6-e8c9-4b6d-865d-7bbb35de5967 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:37.339749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61853c0-3ae2-4544-92c4-40ec7df347e4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:37.343332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:37.363295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:37.363957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.364285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.364497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:37.364617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.380526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:37.381178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.381457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.381730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.384404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:37.385862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:37.403578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:37.405345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:37.411663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:37.412975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:37.413936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:37.419624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 401/791] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:37.435911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:37.438055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:37.440278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:37.440278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:37.440278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:37.440278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:37.440278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 391/792] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:37.442286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.447191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.606130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8168f72-8ad9-4b2c-a0a7-da948ab419d6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:37.651070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19ecc2-1cb0-405b-ae81-b0b8d5f257c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:37.653205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ecc2-1cb0-405b-ae81-b0b8d5f257c6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.654480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ecc2-1cb0-405b-ae81-b0b8d5f257c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.655509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ecc2-1cb0-405b-ae81-b0b8d5f257c6 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.656682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19ecc2-1cb0-405b-ae81-b0b8d5f257c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:37.658171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19ecc2-1cb0-405b-ae81-b0b8d5f257c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:37.659112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68067-c029-4263-8948-8a4e59e7b4ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:37.659700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19ecc2-1cb0-405b-ae81-b0b8d5f257c6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:37.681886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 402/793] 10.222.0.121 () {56 vars in 1140 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:37.687365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e755-7036-42ff-814f-013b8ac5b917 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.687875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e755-7036-42ff-814f-013b8ac5b917 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.688490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5e755-7036-42ff-814f-013b8ac5b917 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.690920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 403/794] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:37 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:37.691958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5e755-7036-42ff-814f-013b8ac5b917 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.701434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543cc77-a8c8-47a9-a17a-ec5b1cf0c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:37.702106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543cc77-a8c8-47a9-a17a-ec5b1cf0c95d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.702428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543cc77-a8c8-47a9-a17a-ec5b1cf0c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.702760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543cc77-a8c8-47a9-a17a-ec5b1cf0c95d None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.703459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543cc77-a8c8-47a9-a17a-ec5b1cf0c95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:37.703770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543cc77-a8c8-47a9-a17a-ec5b1cf0c95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:37.705574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543cc77-a8c8-47a9-a17a-ec5b1cf0c95d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:37.725855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 392/795] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:37.725855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35635-ca51-4aed-9bc0-9c1160456e12 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.725855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35635-ca51-4aed-9bc0-9c1160456e12 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.725855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35635-ca51-4aed-9bc0-9c1160456e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.744739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fef35635-ca51-4aed-9bc0-9c1160456e12 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:37.745937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fef35635-ca51-4aed-9bc0-9c1160456e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:37.759296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:37.779229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:37.822975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5e755-7036-42ff-814f-013b8ac5b917 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:37.832544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 393/796] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:37 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:37.833874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef35635-ca51-4aed-9bc0-9c1160456e12 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.884322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:37.888610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:37.889591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:37.890132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:37.904949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:37.907266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:37.923780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:37.924724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:37.925614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:37.925614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:37.925614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:37.925614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:37.927819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 404/797] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:37.928847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:37.959093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef35635-ca51-4aed-9bc0-9c1160456e12 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.002482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.004178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.004741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.005219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.013519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.015338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:38.029887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:38.031080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:38.032049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:38.038661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 394/798] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:38.039858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.042068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80edd-51ae-409d-8c63-920edbd7368c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.043686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.071945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.085507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.086440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.086881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.087389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.099256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:38.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:38.106423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:38.107407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:38.114928 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 405/799] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:38.116065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.150442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ee3e0-6132-4594-ad17-92faebaa8b3a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.184950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.185563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.185846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.186122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.186838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:38.187138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.188491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.200787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 395/800] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:38.201573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.228881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533decf-80e4-437c-8dc1-566fe90bd38c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.265797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846c1d8-035f-4c7b-8abf-cdc9242e3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.266702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846c1d8-035f-4c7b-8abf-cdc9242e3586 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.267134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846c1d8-035f-4c7b-8abf-cdc9242e3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.267560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846c1d8-035f-4c7b-8abf-cdc9242e3586 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.268714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846c1d8-035f-4c7b-8abf-cdc9242e3586 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:38.269205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846c1d8-035f-4c7b-8abf-cdc9242e3586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.270909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846c1d8-035f-4c7b-8abf-cdc9242e3586 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.287380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.294248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 406/801] 10.222.0.121 () {56 vars in 1154 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:38.295829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec677c8-e0c2-49a9-a0fb-81e2dde34014 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.296270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec677c8-e0c2-49a9-a0fb-81e2dde34014 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.296703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec677c8-e0c2-49a9-a0fb-81e2dde34014 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.298124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 407/802] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:38.298965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec677c8-e0c2-49a9-a0fb-81e2dde34014 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.310003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc31b9-a4c3-48a0-9334-efd64ee7aab5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.326078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.347106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.347730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.348010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.348474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.348997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:38.349303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.350681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.359260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 396/803] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:38.364814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.412222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec677c8-e0c2-49a9-a0fb-81e2dde34014 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.448807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67b52f-17cc-437f-93a7-095c9274362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.449731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b52f-17cc-437f-93a7-095c9274362b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.450019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b52f-17cc-437f-93a7-095c9274362b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.450318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67b52f-17cc-437f-93a7-095c9274362b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.458629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67b52f-17cc-437f-93a7-095c9274362b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.460072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67b52f-17cc-437f-93a7-095c9274362b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-fe67b52f-17cc-437f-93a7-095c9274362b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:38.472557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:38.473459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:38.474371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:38.474804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba60862-dbbd-4872-b6e8-38a0b7a96958 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.474886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 408/804] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:38.475412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7108-178b-4293-b27d-1d4f9e9b5757 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.475639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7108-178b-4293-b27d-1d4f9e9b5757 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.475984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7108-178b-4293-b27d-1d4f9e9b5757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.495140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2a1a7108-178b-4293-b27d-1d4f9e9b5757 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:38.496427 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2a1a7108-178b-4293-b27d-1d4f9e9b5757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:38.516105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.516753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.517034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.517305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.528820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.530605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.537604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:38.547197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:38.548112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:38.549008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:38.549008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:38.549008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:38.549008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:38.550397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 397/805] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:38.551216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.574326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 409/806] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:38 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:38.575524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7108-178b-4293-b27d-1d4f9e9b5757 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.589237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.662307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0735e8-d12f-4b4d-9ce0-183f88f7e14c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.687675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7108-178b-4293-b27d-1d4f9e9b5757 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.696353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.697004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.697287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.697558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.709541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.711018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:38.726679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:38.727616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:38.728498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:38.728498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:38.728498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:38.728498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:38.728498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 398/807] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:38.728849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.743115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.743744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.744028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.744302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.745064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:38.745429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.746889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.764338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 410/808] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:38.764338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.793020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.842360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:38.847887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45cd4-5fd9-4665-9daa-dda27a3fb0e1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.876109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba109065-9e1f-4268-b4e5-de57868a5702 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:38.883540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.884571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.884855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.885128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.886361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:38.892433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.892433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.906160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 399/809] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:38.907035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:38.914249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:38.914939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:38.915255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:38.915510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:38.916143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:38.917522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:38.927456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:38.928428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:38.929324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 411/810] 10.222.0.121 () {56 vars in 1134 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:38.930222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.009593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137077b7-fb64-4da4-b88a-719cd7ec66c8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.020403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.028729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606c753-a1bc-4acf-aee3-045b4613801c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.043208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682d94-b0eb-428a-9dca-379048bf3928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.043829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682d94-b0eb-428a-9dca-379048bf3928 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.044112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682d94-b0eb-428a-9dca-379048bf3928 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.044390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682d94-b0eb-428a-9dca-379048bf3928 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.045070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682d94-b0eb-428a-9dca-379048bf3928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:39.045373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682d94-b0eb-428a-9dca-379048bf3928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.046763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682d94-b0eb-428a-9dca-379048bf3928 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.058443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 400/811] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:39.059641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b6473-6bf8-4874-8b74-b5ef0b444fcb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.059932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b6473-6bf8-4874-8b74-b5ef0b444fcb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.060216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b6473-6bf8-4874-8b74-b5ef0b444fcb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.061432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 401/812] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:39 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:39.063110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b6473-6bf8-4874-8b74-b5ef0b444fcb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.063366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.064137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.064424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.064701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fc5b0b0e563f46c693361b1f9bfc66d5/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.067386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=fc5b0b0e563f46c693361b1f9bfc66d5, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.068820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.071186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.082582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 412/813] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:38 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fc5b0b0e563f46c693361b1f9bfc66d5/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:50:39.083385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.179145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b6473-6bf8-4874-8b74-b5ef0b444fcb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.208348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740fc0-9fe0-4609-b724-01b0516e8cff None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.219483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.220453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.220912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.221335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.230810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.232912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:39.247772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:39.248725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:39.249636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 402/814] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:39.250154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.252354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056ce50-7b66-4095-936f-030fc3e208ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.253521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ce50-7b66-4095-936f-030fc3e208ee None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.253808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ce50-7b66-4095-936f-030fc3e208ee None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.254086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ce50-7b66-4095-936f-030fc3e208ee None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.255343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ce50-7b66-4095-936f-030fc3e208ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:39.255343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ce50-7b66-4095-936f-030fc3e208ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.256659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ce50-7b66-4095-936f-030fc3e208ee None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.261715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 413/815] 10.222.0.121 () {56 vars in 1129 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:39.263170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39d5c-bfa4-4293-827d-e30fd73ad12f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.263463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39d5c-bfa4-4293-827d-e30fd73ad12f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.263743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e39d5c-bfa4-4293-827d-e30fd73ad12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.282404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-93e39d5c-bfa4-4293-827d-e30fd73ad12f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:39.283254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.283615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93e39d5c-bfa4-4293-827d-e30fd73ad12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:39.344037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.356737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e4311-6c40-4dbf-b1c1-e94a50b1fd2b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.362289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 414/816] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:39 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:39.363187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39d5c-bfa4-4293-827d-e30fd73ad12f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.404635 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.406072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.406545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.406968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.417971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.420198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:39.434549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:39.435698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:39.436821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 403/817] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:39.437504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.476746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e39d5c-bfa4-4293-827d-e30fd73ad12f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.512297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.513089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.513370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.513640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.514415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:39.514718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.516230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.535249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 415/818] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:39.535249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.543427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.555530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765a033-c950-4b07-bebb-f7f7e6fa5c74 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.587643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.590979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.591635 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.591912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.592186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.592870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:39.593175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.594548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.600071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 404/819] 10.222.0.121 () {56 vars in 1129 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:39.600774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.649691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017604-7f67-4f8b-a66e-5a9a01c64e1d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.686427 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.687067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.687337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.687613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] PATH_INFO: `/v3/services/network` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.688235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.689699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:39.699444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:39.700692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:39.701531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 416/820] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:39.702338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.711131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5cd7c-2bee-4317-bf68-36318107db49 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.746057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.746714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.747003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.747285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.748077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:39.748388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.749819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.774998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 405/821] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:39.775718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.791972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.810289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edf66-e866-40d3-b03d-bc7054145cae None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.825523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:39.850879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.851890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.851890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.852169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/1037da4d8e26461abaed2fb3fce7e81d/roles/6f8906aa325c40b491f8a8fc312f5139` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.868856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=1037da4d8e26461abaed2fb3fce7e81d, role_id=6f8906aa325c40b491f8a8fc312f5139)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.870340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.898289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 417/822] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:39 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/1037da4d8e26461abaed2fb3fce7e81d/roles/6f8906aa325c40b491f8a8fc312f5139 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:50:39.898582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd955938-bb8b-443b-b23e-08bd04a0f11a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:39.899050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:39.929542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:39.930193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:39.930562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:39.930841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:39.931637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:39.933033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:39.966651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 406/823] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:50:39 2022] POST /identity/v3/endpoints => generated 348 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:39.967802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:40.057011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:40.089915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b53fe-eea3-4b95-967d-97674d926c97 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:40.111266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c615b17-d3e8-4789-b4f2-c4ed6153d054 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:40.135078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:40.136290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:40.136804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:40.137278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:40.138522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] RBAC: Adding query filter params (name=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:40.139048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:40.140703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:40.152125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 418/824] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/services?name=network => generated 125 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:40.155082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:40.155544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:40.156337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:40.156699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:40.157055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:40.201102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:40.245617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:40.247891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:40.296500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44c9e7-be05-4499-b85d-d16c3c03c4cf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:40.330008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:40.336524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:40.337365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:40.337871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:40.338442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:40.339357 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] RBAC: Adding query filter params (type=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:40.339938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:40.341559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:40.347497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 419/825] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:40 2022] GET /identity/v3/services?type=network => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:40.353152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:40.380336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 407/826] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:39 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:50:40.383517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:40.491277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990af87-d048-4949-8b18-d3d707a1fb20 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:40.530111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:40.530921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:40.531265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:40.531544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:40.543375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:40.550284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:40.561245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:40.562181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:40.563094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:40.563094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:40.563094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:40.563094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:40.566519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 408/827] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:40.568874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:40.587424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:40.594042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:40.604231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404d00c-e9a4-4047-97c7-0891db8f0b33 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:40.680070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16102de4-8200-45a5-9f94-28b9de069975 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:40.714929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:40.715568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:40.715850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:40.716127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:40.716819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:40.717126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:40.718518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:40.723064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:40.723971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:40.724485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:40.724981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:40.725919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:40.727877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:40.737821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 409/828] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:40.742629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:40.783727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 420/829] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:50:40 2022] POST /identity/v3/endpoints => generated 329 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:50:40.855633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:40.865939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42283307-2d92-4fae-becc-9ce1d872018b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:40.912697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:40.913373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:40.913730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:40.914003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:40.921380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:40.922932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:40.936194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:40.937210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:40.938099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:40.942404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 410/830] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:40.944193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:41.065818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45af60-f013-40e4-b647-1f3a32d1fcf9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:41.111306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ced6c-eda8-4ab6-b8e9-8e65667d0499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:41.111853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ced6c-eda8-4ab6-b8e9-8e65667d0499 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:41.112747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ced6c-eda8-4ab6-b8e9-8e65667d0499 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:41.113026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ced6c-eda8-4ab6-b8e9-8e65667d0499 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:41.113778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ced6c-eda8-4ab6-b8e9-8e65667d0499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:41.114092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ced6c-eda8-4ab6-b8e9-8e65667d0499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:41.115541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ced6c-eda8-4ab6-b8e9-8e65667d0499 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:41.133265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 421/831] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:41.138605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:41.243318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fb572-5818-4742-a22f-2ede28e710f3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:41.247614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95c9a-2a6f-4ad0-ba0e-edcdbc1dcfd3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:41.247891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95c9a-2a6f-4ad0-ba0e-edcdbc1dcfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:41.248163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95c9a-2a6f-4ad0-ba0e-edcdbc1dcfd3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:41.249695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 422/832] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:50:41.254705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f13b1-bbec-4446-9e17-c30924a3f435 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:41.255110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f13b1-bbec-4446-9e17-c30924a3f435 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:41.255492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f13b1-bbec-4446-9e17-c30924a3f435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:41.270246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:41.278155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:41.279548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd7f13b1-bbec-4446-9e17-c30924a3f435 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:41.282031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd7f13b1-bbec-4446-9e17-c30924a3f435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:41.285129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:41.285887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:41.286539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:41.287882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:41.288004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fa3215124493472d89807ab5845258fb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:41.288409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:41.290184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:41.298013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 411/833] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:41 2022] GET /identity/v3/role_assignments?user.id=fa3215124493472d89807ab5845258fb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:41.372900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 423/834] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:41 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:41.408267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:41.535284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8a867-9b06-49c3-bdc8-3be28e103614 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:41.570428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:41.571076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:41.571359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:41.571636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:41.582129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:41.587458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:41.588376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:41.589231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 412/835] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:41.594836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f13b1-bbec-4446-9e17-c30924a3f435 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:41.704539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f13b1-bbec-4446-9e17-c30924a3f435 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:41.740323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:41.741202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:41.741634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:41.742078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:41.743092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:41.743626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:41.745205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:41.753649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:41.758776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 424/836] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:41.764348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:41.824719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:41.871131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4275e-e71e-49d1-a157-33f67bbfd007 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:41.907216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:41.907873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:41.908153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:41.908427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:41.920201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:41.921656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:41.936939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:41.937886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:41.938806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:41.938806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:41.938806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:41.938806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:41.942363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 413/837] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:41.944829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.047295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98569-bc03-49eb-9e3e-1cead7c9ae18 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:42.082029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:42.082998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.083455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.083953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.084836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:42.085401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:42.086972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:42.101156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 425/838] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:42.106954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.213899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88082a2-5086-4b9d-a702-48fcf498509a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:42.224168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:42.250797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0463-5d9f-4bfd-be28-f503a82c1d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:42.251821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0463-5d9f-4bfd-be28-f503a82c1d5e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.252299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0463-5d9f-4bfd-be28-f503a82c1d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.253356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0463-5d9f-4bfd-be28-f503a82c1d5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.261604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0463-5d9f-4bfd-be28-f503a82c1d5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:42.263591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0463-5d9f-4bfd-be28-f503a82c1d5e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c48d0463-5d9f-4bfd-be28-f503a82c1d5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:42.276067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:42.277034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 16:50:42.277963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:42.285033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 414/839] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:42.286717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.310215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0ebd-7a31-4f53-8ade-a7ff97c9416d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.310503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0ebd-7a31-4f53-8ade-a7ff97c9416d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.310742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0ebd-7a31-4f53-8ade-a7ff97c9416d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.312319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 415/840] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:50:42.317775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2986801-f2df-446a-b0d0-153a492a4de7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.318062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2986801-f2df-446a-b0d0-153a492a4de7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.318383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2986801-f2df-446a-b0d0-153a492a4de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.341310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e2986801-f2df-446a-b0d0-153a492a4de7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:42.342896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e2986801-f2df-446a-b0d0-153a492a4de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:42.355232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:42.401140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a9207-ed6b-4407-992d-100383cde085 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:42.425554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 416/841] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:42 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:42.427149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e19c2-1460-4ce5-bf14-3535e08c2dc8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.427543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e19c2-1460-4ce5-bf14-3535e08c2dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.427820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e19c2-1460-4ce5-bf14-3535e08c2dc8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.429390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 417/842] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:42.435589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d068c-4b58-42fb-b097-086c8c0eef91 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.435979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d068c-4b58-42fb-b097-086c8c0eef91 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.436350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d068c-4b58-42fb-b097-086c8c0eef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.439433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:42.440256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.440685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.441126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.442068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:42.442548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:42.444110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:42.457318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-316d068c-4b58-42fb-b097-086c8c0eef91 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:42.458571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-316d068c-4b58-42fb-b097-086c8c0eef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:42.465676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 426/843] 10.222.0.121 () {56 vars in 1140 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:42.467294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.538496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 418/844] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:42 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:42.539771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d068c-4b58-42fb-b097-086c8c0eef91 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.570150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:42.583590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce823a7-3c4e-40c2-8f15-6af7ced2424b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:42.602347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:42.623647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:42.624305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.624590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.624870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.625505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:42.626904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:42.635987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:42.637003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:42.638110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 427/845] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:42.638932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.658376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d068c-4b58-42fb-b097-086c8c0eef91 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:42.699404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:42.700032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.700323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.700828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.756802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22cfe-6a7e-440f-98a7-8eb27f07493f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:42.775194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:42.776730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:42.796066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:42.796724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.797010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.797287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.806308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:42.808132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:42.814040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:42.815156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 428/846] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:42.816035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.875763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:42.898122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 419/847] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:50:42.899105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:42.950051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a449d81-8f30-45ab-94e1-bad0d89679c3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:42.985650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:42.986290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:42.986584 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:42.986892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:42.987593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:42.987904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:42.989277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:42.993977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 429/848] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:42.994697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.009337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636be4f-2696-4eba-96cf-c182a3558f7c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.040263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.049531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.050161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.050473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.050753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.051478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:43.051786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.053150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.061510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 420/849] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:43.063129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.104829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0ffaf-d3eb-4b98-9317-81af621907b3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.108283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.144350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.144922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.145213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.145490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.156433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.157883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:43.173990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:43.175720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:43.181741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:43.181741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:43.181741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:43.181741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:43.181977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548878-f60d-4b25-979e-a5e9e9dc77fc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.182061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 430/850] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:43.182061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.219835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.220581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.220865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.221142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.222505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:43.222815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.224183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.242629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 421/851] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:43.243457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.290276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d187e54-2bcc-486d-9eeb-76fb8f23a41f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.309263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.332776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.333447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.333729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.334005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.347722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.349379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.365486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed170-0a1f-4cb1-8a18-c2851214e924 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:43.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:43.367419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:43.368325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:43.368325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:43.368325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:43.368325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:43.368325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 431/852] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:43.373567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.389701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.407382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.407998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.408292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.408570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.409899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:43.410445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.411632 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.426873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 422/853] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:43.432450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.499371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c122067-ad7c-4a28-a991-357faeacf82b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.538249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01b6ea-07a6-4fad-ad4b-22195cf0e2ef None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.538643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9acaf-9a25-4631-8662-fe0cde5f3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.539518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9acaf-9a25-4631-8662-fe0cde5f3eee None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.540056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9acaf-9a25-4631-8662-fe0cde5f3eee None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.540635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9acaf-9a25-4631-8662-fe0cde5f3eee None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.541551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9acaf-9a25-4631-8662-fe0cde5f3eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:43.542057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9acaf-9a25-4631-8662-fe0cde5f3eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.543659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9acaf-9a25-4631-8662-fe0cde5f3eee None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.553433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.560235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 432/854] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:43.566599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddee61-8167-4778-b773-66f4ac51083e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.566891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddee61-8167-4778-b773-66f4ac51083e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.567173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddee61-8167-4778-b773-66f4ac51083e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.568481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 433/855] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:43.569303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddee61-8167-4778-b773-66f4ac51083e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.578552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51df72-3145-4399-888d-4ca2c4514af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.579212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51df72-3145-4399-888d-4ca2c4514af0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.579494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51df72-3145-4399-888d-4ca2c4514af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.579771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51df72-3145-4399-888d-4ca2c4514af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.588622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51df72-3145-4399-888d-4ca2c4514af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.590068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51df72-3145-4399-888d-4ca2c4514af0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4d51df72-3145-4399-888d-4ca2c4514af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:43.602589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:43.603519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:43.604400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 423/856] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:43.604888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49b2ca-6834-4652-a86e-d3073d7dcb41 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.605286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49b2ca-6834-4652-a86e-d3073d7dcb41 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.605434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49b2ca-6834-4652-a86e-d3073d7dcb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.622910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-be49b2ca-6834-4652-a86e-d3073d7dcb41 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:43.624090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-be49b2ca-6834-4652-a86e-d3073d7dcb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:43.652056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.690637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddee61-8167-4778-b773-66f4ac51083e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.701964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 424/857] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:43 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:43.702751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49b2ca-6834-4652-a86e-d3073d7dcb41 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.732748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.733414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.733703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.733983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.742400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.743847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:43.757000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:43.757983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 434/858] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:43.759290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.817046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49b2ca-6834-4652-a86e-d3073d7dcb41 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.820131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.854714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.855328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.855609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.855880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.856625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:43.856932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.858366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.869942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88a44-3ee6-44c0-90c0-267d7459ca4a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:43.870188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 425/859] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:43.870980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.904956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:43.914121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:43.914829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:43.915118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:43.916084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:43.916084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:43.917384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:43.927205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:43.928162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:43.929011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 435/860] 10.222.0.121 () {56 vars in 1137 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:43.929947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:43.998299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da6754-dd74-4a0c-9833-b6661e2e9ab6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:44.035071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:44.035709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:44.035973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:44.036247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:44.037045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:44.037383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:44.038840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:44.046712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff4a9a-23f7-433f-b118-6719c8b688be None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:44.056324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 426/861] 10.222.0.121 () {56 vars in 1154 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:44.056933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:44.086207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:44.086872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:44.087045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:44.087139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:44.087428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:44.088249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fc5b0b0e563f46c693361b1f9bfc66d5) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:44.088670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:44.090306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:44.096234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 436/862] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:43 2022] GET /identity/v3/role_assignments?user.id=fc5b0b0e563f46c693361b1f9bfc66d5&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:44.097526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:44.164157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:44.210981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040ec5e-3d9e-4460-99fa-ba56f9bfeae6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:44.216916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3544c6-9562-4e54-a447-cffb8b28e1f8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:44.264996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:44.265658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:44.265943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:44.266220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:44.267435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:44.268830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:44.269559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:44.270045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:44.271478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:44.271768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:44.273148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:44.279660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 427/863] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:44 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:44.286395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:44.367742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:44.369204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:44.396051 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:44.419574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b2c0-a408-4674-887b-08b95faef4a1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:44.431687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:44.469757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:44.470286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:44.470667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:44.471020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:44.472436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:44.472812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:44.474399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:44.486287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 428/864] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:44 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:44.492138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 437/865] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:44 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:50:44.497904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:44.611508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163b1c3-0b02-435e-9529-35e97bb4497d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:44.649431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:44.650210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:44.650599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:44.650953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:44.663471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:44.665182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:44.682373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:44.683489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:44.684570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:44.684570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:44.684570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:44.684570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:44.686411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 429/866] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:44.693273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:44.805329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694d60e-3291-46b2-a60f-15b440c93d94 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:44.841673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:44.842323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:44.842611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:44.842892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:44.843592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:44.843896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:44.845258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:44.857904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 438/867] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:44.863984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:44.867033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:44.985492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be20cc-54b8-4e10-828e-1472371ba332 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:45.022530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:45.023554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:45.024046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:45.024558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:45.031706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:45.033363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:45.045365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:45.046743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:45.047615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:45.054586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 430/868] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:45.056519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:45.076688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:45.165480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c20df-8649-4ddf-8315-6523e7bc8276 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:45.201799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854f34-cb9d-499d-8cec-d07fdb423760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:45.202826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854f34-cb9d-499d-8cec-d07fdb423760 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:45.203338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854f34-cb9d-499d-8cec-d07fdb423760 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:45.203831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854f34-cb9d-499d-8cec-d07fdb423760 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:45.204788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854f34-cb9d-499d-8cec-d07fdb423760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:45.205307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854f34-cb9d-499d-8cec-d07fdb423760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:45.207478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854f34-cb9d-499d-8cec-d07fdb423760 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:45.220832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 439/869] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:45.227076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:45.293887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:45.312345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa73b-b4cb-48ca-8774-8e23489a6748 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:45.312987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa73b-b4cb-48ca-8774-8e23489a6748 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:45.313466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aa73b-b4cb-48ca-8774-8e23489a6748 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:45.315803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 440/870] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:45.321052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074ef66-2838-4aa6-b76e-1246f2542732 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:45.321566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074ef66-2838-4aa6-b76e-1246f2542732 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:45.322063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074ef66-2838-4aa6-b76e-1246f2542732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:45.337187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7ecc8-072a-4e23-9fcd-ed4281bb57fc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:45.341411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0074ef66-2838-4aa6-b76e-1246f2542732 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:45.342973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0074ef66-2838-4aa6-b76e-1246f2542732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:45.372190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:45.373052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:45.373164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:45.373368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:45.374243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=1037da4d8e26461abaed2fb3fce7e81d) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:45.374683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:45.376043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:45.386648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 431/871] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:45 2022] GET /identity/v3/role_assignments?user.id=1037da4d8e26461abaed2fb3fce7e81d&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:45.421378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 441/872] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:45 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:45.445447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:45.553330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc0950-2ca8-4755-8256-0af1fac069e0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:45.580359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:45.590396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6148e0-00ae-4445-98b5-775a3092b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:45.591034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6148e0-00ae-4445-98b5-775a3092b87a None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:45.591316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6148e0-00ae-4445-98b5-775a3092b87a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:45.591589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6148e0-00ae-4445-98b5-775a3092b87a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:45.592300 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6148e0-00ae-4445-98b5-775a3092b87a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:45.593662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6148e0-00ae-4445-98b5-775a3092b87a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:45.609672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 432/873] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:50:45 2022] POST /identity/v3/services => generated 252 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:46.208857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32e40-5182-4f38-b815-c898d4f397da None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.209379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32e40-5182-4f38-b815-c898d4f397da None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.209457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a32e40-5182-4f38-b815-c898d4f397da None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.211073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 442/874] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:46.218117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16167-c6e6-46b5-a01a-8ce353ca5abc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.218609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16167-c6e6-46b5-a01a-8ce353ca5abc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.218689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16167-c6e6-46b5-a01a-8ce353ca5abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.238001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d5f16167-c6e6-46b5-a01a-8ce353ca5abc None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:46.239213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d5f16167-c6e6-46b5-a01a-8ce353ca5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:46.312314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 433/875] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:46 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:46.335231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a32e40-5182-4f38-b815-c898d4f397da None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:46.344714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:46.447132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a32e40-5182-4f38-b815-c898d4f397da None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:46.484297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a99126-d064-4392-81b7-a979852fa31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:46.485266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a99126-d064-4392-81b7-a979852fa31c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.485771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a99126-d064-4392-81b7-a979852fa31c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.486248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a99126-d064-4392-81b7-a979852fa31c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.487716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a99126-d064-4392-81b7-a979852fa31c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:46.489304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a99126-d064-4392-81b7-a979852fa31c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-10a99126-d064-4392-81b7-a979852fa31c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:46.499140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:46.507876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:46.508898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 443/876] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:46.509927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f16167-c6e6-46b5-a01a-8ce353ca5abc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:46.610849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f16167-c6e6-46b5-a01a-8ce353ca5abc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:46.615089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd3f7-7efb-4ba9-9a0a-436bf9cd976c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.615500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd3f7-7efb-4ba9-9a0a-436bf9cd976c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.615884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd3f7-7efb-4ba9-9a0a-436bf9cd976c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.617589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 444/877] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:50:46.622532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590327c-33e1-499e-901c-a31ae12a66d7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.622902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590327c-33e1-499e-901c-a31ae12a66d7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.623264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590327c-33e1-499e-901c-a31ae12a66d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.626510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:46.646310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6590327c-33e1-499e-901c-a31ae12a66d7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:46.647828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6590327c-33e1-499e-901c-a31ae12a66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:46.648604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:46.649234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.649513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.649784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.650488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:46.650793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:46.652251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:46.657319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 434/878] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:46 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:46.665414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:46.720839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:46.730348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 445/879] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:46 2022] POST /identity/v3/auth/tokens => generated 1254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:46.750811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590327c-33e1-499e-901c-a31ae12a66d7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:46.804380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57773-2a17-4ee7-9893-5d832a9ead5d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:46.850202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d405-9c5b-4bb5-b56f-35fe3a8c1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:46.850994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d405-9c5b-4bb5-b56f-35fe3a8c1403 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.851349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d405-9c5b-4bb5-b56f-35fe3a8c1403 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.851700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d405-9c5b-4bb5-b56f-35fe3a8c1403 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.852458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d405-9c5b-4bb5-b56f-35fe3a8c1403 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:46.852838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d405-9c5b-4bb5-b56f-35fe3a8c1403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:46.854480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d405-9c5b-4bb5-b56f-35fe3a8c1403 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:46.859440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 435/880] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:46 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:46.875080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590327c-33e1-499e-901c-a31ae12a66d7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:46.916176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eaacd-799b-4f5b-9f34-4e7d8c7b3d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:46.917175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eaacd-799b-4f5b-9f34-4e7d8c7b3d04 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:46.917676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eaacd-799b-4f5b-9f34-4e7d8c7b3d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:46.918139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eaacd-799b-4f5b-9f34-4e7d8c7b3d04 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:46.919061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eaacd-799b-4f5b-9f34-4e7d8c7b3d04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:46.920829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eaacd-799b-4f5b-9f34-4e7d8c7b3d04 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:46.940538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 446/881] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:50:46 2022] POST /identity/v3/services => generated 270 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:50:47.636873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ef49-903c-4e03-94ae-88695b443f25 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:47.637816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ef49-903c-4e03-94ae-88695b443f25 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:47.637816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ef49-903c-4e03-94ae-88695b443f25 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:47.639536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 436/882] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:47.645603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f66a-d034-4978-85c4-089176897c38 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:47.646047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f66a-d034-4978-85c4-089176897c38 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:47.646271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f66a-d034-4978-85c4-089176897c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:47.665546 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-06f7f66a-d034-4978-85c4-089176897c38 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:47.667170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-06f7f66a-d034-4978-85c4-089176897c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:47.724019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7c1d-6793-4f77-841d-a90d1916bd31 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:47.724283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7c1d-6793-4f77-841d-a90d1916bd31 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:47.724675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7c1d-6793-4f77-841d-a90d1916bd31 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:47.727624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 437/883] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:47.732245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92814-f0f9-4761-896f-79381d135456 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:47.732574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92814-f0f9-4761-896f-79381d135456 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:47.733023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92814-f0f9-4761-896f-79381d135456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:47.751943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:47.753336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4cf92814-f0f9-4761-896f-79381d135456 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:47.754609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4cf92814-f0f9-4761-896f-79381d135456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:47.776946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 447/884] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:47 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:47.804308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:47.804503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7f66a-d034-4978-85c4-089176897c38 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:47.842474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 438/885] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:47 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:47.871374 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf92814-f0f9-4761-896f-79381d135456 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:47.966985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7f66a-d034-4978-85c4-089176897c38 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:47.989884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf92814-f0f9-4761-896f-79381d135456 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.017776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.018578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.018860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.019135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.030975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:48.036296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:48.037227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:50:48.038056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:48.042211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 448/886] 10.222.0.121 () {56 vars in 1125 bytes} [Mon Aug 1 16:50:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:48.043496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.044551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.045216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.045495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.045788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.046561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.047937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:48.058295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:48.059390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:48.060309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:48.064489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 439/887] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:48.066392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.103835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:48.108926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:48.182133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcea02-46fd-4bd3-bd8d-46047fdb0f4c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.188268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19637-d41f-419c-8dc9-35cba016ae35 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.226560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.227565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.228089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.228424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.229179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:48.229590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.231070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.241740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 440/888] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:48.243420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.249322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.249957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.250236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.250541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.251272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:48.251574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.253482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.267763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 449/889] 10.222.0.121 () {56 vars in 1120 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:48.269518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.357767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:48.362847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080aa4-709d-4f80-86b9-358796a45254 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.400638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.401662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.401907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aa7fd-0bea-4021-a6f4-6b97b6610e0f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.402426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.402910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.403878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:48.404398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.406006 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.416767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:48.417508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 441/890] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:48.419336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.455030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.456878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.457841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.458364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.484530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.487663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:48.506373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:48.507328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:48.508351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:48.508351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:48.508351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:48.508351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:48.514453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 450/891] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:48.517315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.551399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61685e-2b94-4b9d-82d9-d47430018d0b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.601243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.602251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.602860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.603342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.604816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] RBAC: Adding query filter params (interface=public, service_id=571a3369c005495ba7bf9d2e7f519c59, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:48.605455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.608109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.629725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 442/892] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/endpoints?service_id=571a3369c005495ba7bf9d2e7f519c59&interface=public®ion_id=RegionOne => generated 195 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:48.632299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.665458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b541-5d8b-4af8-a93a-4571b055c893 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.684768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:48.715007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.716142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.716596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.717269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.718602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:48.719049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.720571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.738000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 451/893] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:48.744467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:48.789947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1ea26-6606-4094-b40a-45bab27dfbe3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.795960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:48.848202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241732b4-8755-4a06-add8-4f2777fe0a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.848866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241732b4-8755-4a06-add8-4f2777fe0a6e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.849197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241732b4-8755-4a06-add8-4f2777fe0a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.849476 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241732b4-8755-4a06-add8-4f2777fe0a6e None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.850139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241732b4-8755-4a06-add8-4f2777fe0a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.851642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241732b4-8755-4a06-add8-4f2777fe0a6e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:48.862409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 443/894] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/services => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:50:48.923924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd4479-3b51-4f50-adad-898530ca3b56 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.924761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd4479-3b51-4f50-adad-898530ca3b56 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.925008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd4479-3b51-4f50-adad-898530ca3b56 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.926713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 444/895] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:48.929396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac7857-4572-486c-b76e-356a38463238 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:48.933351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2fa4-3b1c-427e-9889-b1d8db1d844c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.933351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2fa4-3b1c-427e-9889-b1d8db1d844c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.933351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a2fa4-3b1c-427e-9889-b1d8db1d844c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.953826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4b3a2fa4-3b1c-427e-9889-b1d8db1d844c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:48.954980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b3a2fa4-3b1c-427e-9889-b1d8db1d844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:48.981199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:48.982573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:48.983089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:48.984049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:48.996044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:48.998948 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:49.014209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:49.015225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:49.016151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 452/896] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:50:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:49.023516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.040633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 445/897] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:48 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:49.065678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a2fa4-3b1c-427e-9889-b1d8db1d844c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.092968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:49.126485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:49.145257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50ba3d-8567-4c7e-9668-ca2b07699b41 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:49.188997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:49.190377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.190947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.191485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.192591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:49.193048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:49.195387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.200575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a2fa4-3b1c-427e-9889-b1d8db1d844c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:49.222658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 453/898] 10.222.0.121 () {56 vars in 1154 bytes} [Mon Aug 1 16:50:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:49.228065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.248191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bebcf-cd05-4571-b3cb-2ea16fa05ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:49.249395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bebcf-cd05-4571-b3cb-2ea16fa05ab2 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.250162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bebcf-cd05-4571-b3cb-2ea16fa05ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.250668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bebcf-cd05-4571-b3cb-2ea16fa05ab2 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.251568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bebcf-cd05-4571-b3cb-2ea16fa05ab2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:49.254342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bebcf-cd05-4571-b3cb-2ea16fa05ab2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.277326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 446/899] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:50:49 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:50:49.279451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0e9b-550e-4236-bcd7-6adf7f0b8e00 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.280064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0e9b-550e-4236-bcd7-6adf7f0b8e00 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.280559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0e9b-550e-4236-bcd7-6adf7f0b8e00 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.283158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 447/900] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:49 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:49.289300 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288ccf-d771-410a-9a8f-0b73bf70223e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.290744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288ccf-d771-410a-9a8f-0b73bf70223e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.291167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81288ccf-d771-410a-9a8f-0b73bf70223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.320823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-81288ccf-d771-410a-9a8f-0b73bf70223e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:49.322294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-81288ccf-d771-410a-9a8f-0b73bf70223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:49.372220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82699631-4821-49eb-901d-9d0380e5de92 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:49.422079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 448/901] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:49 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:49.429284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:49.430567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.431063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.431559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.442654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:49.445665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288ccf-d771-410a-9a8f-0b73bf70223e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.456080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:49.527423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:49.528967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.569578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81288ccf-d771-410a-9a8f-0b73bf70223e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:49.610987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:49.611682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.612239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.612522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.613870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:49.615605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:49.627937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:49.629520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:49.630970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 449/902] 10.222.0.121 () {56 vars in 1137 bytes} [Mon Aug 1 16:50:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:49.636035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.663889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 454/903] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:49 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 16:50:49.671865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.719725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:49.728527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:49.761535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9320b-b9c2-4d28-b7ed-503bbb7ea1ea None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:49.803317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:49.803632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8fc52-75d7-4095-82f7-d5e7203c92d3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:49.803872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.804244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.804526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.805403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:49.805712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:49.807756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.815911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 450/904] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:49 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:49.821386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.848760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:49.850317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.850950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.851513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.865311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:49.867581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:49.888795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:49.889762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:49.890686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:49.890686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:49.890686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:49.890686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:49.897861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 455/905] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:49.900447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:49.947338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d927b-3208-48bb-bd5d-5695dd3dad16 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:49.987544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:49.988186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:49.988474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:49.988761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:49.989817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:49.990147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:49.991847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:49.993477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:50.003720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 451/906] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:49 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:50.006834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:50.035565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:50.049375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f757f-58c7-4a31-a1a3-f3db838fecec None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:50.095692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:50.097393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:50.097883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:50.098825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:50.100063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:50.100592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:50.103547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:50.127280 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 456/907] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:50.135290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:50.146570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d2d9c-2e5a-484b-95c6-53046732b8d9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:50.205445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:50.206453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:50.207000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:50.207578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:50.209488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] RBAC: Adding query filter params (interface=public, service_id=542cf319376b4f48943b1ddee8779b1c, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:50.210097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:50.212903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:50.229794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 452/908] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:50:50 2022] GET /identity/v3/endpoints?service_id=542cf319376b4f48943b1ddee8779b1c&interface=public®ion_id=RegionOne => generated 195 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:50.232432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:50.245869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0344-4da9-438b-9ba1-7ccf8813e8a3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:50.281906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:50.282819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:50.283297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:50.283776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:50.291023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:50.292694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:50.306090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:50.307019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:50.307906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:50.315967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 457/909] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:50.317911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:50.330892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:50.350803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:50.421860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d2a9c-0802-4e9a-b218-d9fed4088a3a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:50.426128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821bf81-9458-4b8d-b87c-8b76633b6784 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:50.462707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:50.463739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:50.464225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:50.464826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:50.466104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:50.466894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:50.468613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:50.478011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347976e-3c60-4f44-a9e3-7d53c85ea34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:50.479122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347976e-3c60-4f44-a9e3-7d53c85ea34f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:50.479574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347976e-3c60-4f44-a9e3-7d53c85ea34f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:50.479970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347976e-3c60-4f44-a9e3-7d53c85ea34f None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:50.481109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347976e-3c60-4f44-a9e3-7d53c85ea34f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:50.483815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347976e-3c60-4f44-a9e3-7d53c85ea34f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:50.489935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 458/910] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:50.491761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:50.500724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 453/911] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:50:50 2022] GET /identity/v3/services => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:50:50.574639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:50.614035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc33b7-c5ab-40c8-a099-03061c9e642e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:50.654085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97d28c-5bb3-424a-b64f-fc53229b9060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:50.655175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d28c-5bb3-424a-b64f-fc53229b9060 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:50.655664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d28c-5bb3-424a-b64f-fc53229b9060 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:50.656139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d28c-5bb3-424a-b64f-fc53229b9060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:50.657157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d28c-5bb3-424a-b64f-fc53229b9060 None admin] RBAC: Adding query filter params (role.id=a5f19542263c4e1abfa302e875ffe7ca, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=1037da4d8e26461abaed2fb3fce7e81d) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:50.657676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d28c-5bb3-424a-b64f-fc53229b9060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:50.659433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d28c-5bb3-424a-b64f-fc53229b9060 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:50.670578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 459/912] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:50:50 2022] GET /identity/v3/role_assignments?user.id=1037da4d8e26461abaed2fb3fce7e81d&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=a5f19542263c4e1abfa302e875ffe7ca => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:51.016804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759497-04fb-417b-acfd-14bed6d8f980 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.017669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759497-04fb-417b-acfd-14bed6d8f980 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.018644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759497-04fb-417b-acfd-14bed6d8f980 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.020392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 454/913] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:51.026473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390da7d-de3c-4260-92ed-10750efeec2e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.027393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390da7d-de3c-4260-92ed-10750efeec2e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.027870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390da7d-de3c-4260-92ed-10750efeec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.047258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e390da7d-de3c-4260-92ed-10750efeec2e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:51.048789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e390da7d-de3c-4260-92ed-10750efeec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:51.123480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 460/914] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:51 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:51.146695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759497-04fb-417b-acfd-14bed6d8f980 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:51.260909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759497-04fb-417b-acfd-14bed6d8f980 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:51.287942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:51.297774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b398-abbd-4946-a775-3ada19a976d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:51.298388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b398-abbd-4946-a775-3ada19a976d5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.298960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b398-abbd-4946-a775-3ada19a976d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.299309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b398-abbd-4946-a775-3ada19a976d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.300015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1b398-abbd-4946-a775-3ada19a976d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:51.301473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1b398-abbd-4946-a775-3ada19a976d5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1ed1b398-abbd-4946-a775-3ada19a976d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:51.311314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:51.312329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 16:50:51.313186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:51.319897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 455/915] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:51.326489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390da7d-de3c-4260-92ed-10750efeec2e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:51.391397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:51.437037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390da7d-de3c-4260-92ed-10750efeec2e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:51.473965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:51.474629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.474915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.475192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.475890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:51.476197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:51.477586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:51.483249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 461/916] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:51 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:51.486117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7d1e-cfe6-48e5-a485-348678d34f7a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.486446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7d1e-cfe6-48e5-a485-348678d34f7a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.486796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f7d1e-cfe6-48e5-a485-348678d34f7a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.488488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 456/917] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:51.489948 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:51.493720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eaca3-733e-403e-afdc-fbc8ee80801f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.494018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eaca3-733e-403e-afdc-fbc8ee80801f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.494336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eaca3-733e-403e-afdc-fbc8ee80801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.515604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fb6eaca3-733e-403e-afdc-fbc8ee80801f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:51.516939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb6eaca3-733e-403e-afdc-fbc8ee80801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:51.610600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 457/918] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:51 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:51.620040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f05a3-1a12-44fc-af3f-c8001be1ea33 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:51.639459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eaca3-733e-403e-afdc-fbc8ee80801f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:51.657830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:51.668506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:51.670185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.671376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.672022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.673276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:51.673801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:51.676006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:51.682120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 462/919] 10.222.0.121 () {56 vars in 1119 bytes} [Mon Aug 1 16:50:51 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:51.687522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:51.768473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eaca3-733e-403e-afdc-fbc8ee80801f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:51.791621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:51.806461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28101d5c-968d-4029-a068-50ff97d1b05d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:51.809908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:51.810894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.811393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.811873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.812733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:51.814340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:51.824506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:51.825582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:51.826461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:51.829016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 458/920] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:51.835716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:51.847753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:51.848386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:51.848664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:51.848934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:51.849730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:51.851209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:51.880931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 463/921] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:50:51 2022] POST /identity/v3/endpoints => generated 348 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:50:51.975624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b98db-e321-4086-b12c-cc0df6e6138c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:52.023337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:52.024867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.025393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.025869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.026850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:52.027350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:52.028938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:52.035992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 459/922] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:51 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:52.042550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:52.106195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:52.163731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a04bed-13ff-4f47-acbe-3dac6badacd8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:52.202907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:52.203586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.203859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.204252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.204938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:52.205341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:52.206863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:52.212820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 464/923] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:52 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:52.218639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:52.276414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:52.342896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151230b-51e6-460d-88b0-4d4ac06ceb87 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:52.387629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bcefd-d993-45ca-bf9b-622c8531bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:52.388940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bcefd-d993-45ca-bf9b-622c8531bd74 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.389559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bcefd-d993-45ca-bf9b-622c8531bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.389992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bcefd-d993-45ca-bf9b-622c8531bd74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.391547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bcefd-d993-45ca-bf9b-622c8531bd74 None admin] RBAC: Adding query filter params (interface=public, service_id=c52035db33c74030ae348e48a3a7cf5b, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:52.392159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bcefd-d993-45ca-bf9b-622c8531bd74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:52.394901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bcefd-d993-45ca-bf9b-622c8531bd74 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:52.404132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 460/924] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:50:52 2022] GET /identity/v3/endpoints?service_id=c52035db33c74030ae348e48a3a7cf5b&interface=public®ion_id=RegionOne => generated 195 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:52.411406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:52.533474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c42edc-14cf-49fa-8fd1-195d6a4fc006 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:52.547758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:52.572242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0408d3-33f0-4862-ac78-8cdd99cd75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:52.572894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0408d3-33f0-4862-ac78-8cdd99cd75d8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.573175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0408d3-33f0-4862-ac78-8cdd99cd75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.573453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0408d3-33f0-4862-ac78-8cdd99cd75d8 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.574121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0408d3-33f0-4862-ac78-8cdd99cd75d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:52.575534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0408d3-33f0-4862-ac78-8cdd99cd75d8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:52.582699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 465/925] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:50:52 2022] GET /identity/v3/services => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:50:52.753068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeff1b2-e015-4904-a149-d13bb1f27d76 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.753466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeff1b2-e015-4904-a149-d13bb1f27d76 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.753653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeff1b2-e015-4904-a149-d13bb1f27d76 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.755417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 461/926] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:52.762109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d88d8-c967-4ecc-9385-a95cf9dd8cd2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.762821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d88d8-c967-4ecc-9385-a95cf9dd8cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.763112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d88d8-c967-4ecc-9385-a95cf9dd8cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.785260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-123d88d8-c967-4ecc-9385-a95cf9dd8cd2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:52.787267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-123d88d8-c967-4ecc-9385-a95cf9dd8cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:52.903037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11897a-8305-4781-ac20-ea5ef9ce5d88 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.903338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11897a-8305-4781-ac20-ea5ef9ce5d88 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.903697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11897a-8305-4781-ac20-ea5ef9ce5d88 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.905167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 462/927] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:52.910288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 466/928] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:52 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:52.911258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8464-8bd2-41b5-b4f8-b70a3cef60f6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:52.911630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8464-8bd2-41b5-b4f8-b70a3cef60f6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:52.911913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8464-8bd2-41b5-b4f8-b70a3cef60f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:52.931157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0c7a8464-8bd2-41b5-b4f8-b70a3cef60f6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:52.932360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0c7a8464-8bd2-41b5-b4f8-b70a3cef60f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:52.950374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d88d8-c967-4ecc-9385-a95cf9dd8cd2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.018384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 463/929] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:52 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:53.042958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8464-8bd2-41b5-b4f8-b70a3cef60f6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.076954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d88d8-c967-4ecc-9385-a95cf9dd8cd2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.087852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:53.088970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:53.131649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.132324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.132596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.132878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.133582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:53.136113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:53.149457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:53.150495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:53.151538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 467/930] 10.222.0.121 () {56 vars in 1137 bytes} [Mon Aug 1 16:50:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:53.156510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.168419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8464-8bd2-41b5-b4f8-b70a3cef60f6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.208886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.209553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.209843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.210126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.222703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:53.228177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:53.229103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:53.229965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 464/931] 10.222.0.121 () {56 vars in 1125 bytes} [Mon Aug 1 16:50:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:53.235917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.294708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083559eb-3b2f-4eb4-aed8-43422a1b168b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.332428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.333058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.333390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.334022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.334513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:53.334829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:53.336286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:53.346696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 468/932] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:53 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:53.348571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.364443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:53.370966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54b2c6-e5d2-4afc-bf56-5cf9c1458b79 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.388428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:53.422791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.423669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.424652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.425090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.425980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:53.426727 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:53.428956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:53.443426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 465/933] 10.222.0.121 () {56 vars in 1120 bytes} [Mon Aug 1 16:50:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:53.451030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.475841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065dba6-756a-4e67-a1da-c3d172ed69d8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.515342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.516147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.516435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.516765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.517470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:53.517872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:53.520544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:53.534341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 469/934] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:53 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:53.536500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.587090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0344e64-4ae7-4b2c-9db3-081d68366fa6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.639515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.640176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.640461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.640736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.653866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:53.655354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:53.669571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:53.670907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:53.671899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:53.672780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:53.672780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:53.672780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:53.672780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:53.677543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 466/935] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:53.678437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec42b8-0555-4baf-8573-c5b5a9fef15d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.678880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:53.696249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:53.728350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.729817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.730319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.730786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.731849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:53.734130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:53.766284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 470/936] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:50:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:53.809848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ff54b-64bf-4e95-8f84-0c5f9ea0f357 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:53.859549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:53.860104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:53.860380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:53.860649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:53.862190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:53.862740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:53.864840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:53.879688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 467/937] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:53.888464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.014232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3898d-d990-4c9f-8c13-d809f686e23e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.051639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761db52a-b530-4e39-911e-a9b3c8848bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:54.052665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761db52a-b530-4e39-911e-a9b3c8848bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.053179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761db52a-b530-4e39-911e-a9b3c8848bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.053665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761db52a-b530-4e39-911e-a9b3c8848bb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.063700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761db52a-b530-4e39-911e-a9b3c8848bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:54.065500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761db52a-b530-4e39-911e-a9b3c8848bb7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-761db52a-b530-4e39-911e-a9b3c8848bb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:54.077594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:54.078991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:54.079930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.083072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 471/938] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:50:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:54.090311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.165756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:54.205991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e20927-6b5b-43cc-87de-da93549b08c4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.209045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356e157-dfd2-4e95-a691-117c22821e0c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.209346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356e157-dfd2-4e95-a691-117c22821e0c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.209629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356e157-dfd2-4e95-a691-117c22821e0c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.211369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 472/939] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:54.218780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2ed2-7c20-4265-be7c-92903c793540 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.219702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2ed2-7c20-4265-be7c-92903c793540 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.220476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d2ed2-7c20-4265-be7c-92903c793540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.244209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:54.244848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.245135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.245416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.246225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:54.246605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:54.248087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:54.253920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6d5d2ed2-7c20-4265-be7c-92903c793540 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:54.256786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6d5d2ed2-7c20-4265-be7c-92903c793540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:54.270083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 468/940] 10.222.0.121 () {56 vars in 1154 bytes} [Mon Aug 1 16:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:54.275427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.280905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:54.366298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 473/941] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:54 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:54.390004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d2ed2-7c20-4265-be7c-92903c793540 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.400714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f03f94-ac1d-4c00-ac85-84beb326945e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.430098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:54.441348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:54.442009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.442313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.442595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.454126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:54.456318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:54.472859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:54.473823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:54.474931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:54.474931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:54.474931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:54.474931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:54.474931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 469/942] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:54.486039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.515673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d2ed2-7c20-4265-be7c-92903c793540 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.555333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:54.556360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.556840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.557316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.558190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:54.559949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:54.563082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING keystone.server.flask.common [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 16:50:54.579561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:54.583769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.sql.core [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 16:50:54.583769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 16:50:54.583769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [parameters: {'id': '8e523c97b5124cb5a54aca0e6f063699', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 16:50:54.583769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 16:50:54.602629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38c6cf-1a9c-4167-a2a8-8d4143c09390 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e523c97b5124cb5a54aca0e6f063699.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e523c97b5124cb5a54aca0e6f063699. Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:50:54.606678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 16:50:54.607514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application yield resource Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise self.value Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application session.commit() Aug 01 16:50:54.608514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.flush() Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application compat.raise_( Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 16:50:54.609430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 16:50:54.610431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:50:54.611248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [parameters: {'id': '8e523c97b5124cb5a54aca0e6f063699', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.619056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:54.621177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e523c97b5124cb5a54aca0e6f063699. Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 474/943] 10.222.0.121 () {60 vars in 1145 bytes} [Mon Aug 1 16:50:54 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:54.623643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.655239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:54.655881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.656167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.656447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.657148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:54.657459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:54.659032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:54.672619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 470/944] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:54.682636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.725943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:54.768605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72ee6-2372-4db4-bf8d-e38dd5b7f74a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.789855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a6e5d-dbf5-4034-aa48-b4f5c4e5de79 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.805877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ea683-062c-4de7-bceb-a64b10cce0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:54.806578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ea683-062c-4de7-bceb-a64b10cce0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.806868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ea683-062c-4de7-bceb-a64b10cce0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.807149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ea683-062c-4de7-bceb-a64b10cce0f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.818417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ea683-062c-4de7-bceb-a64b10cce0f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:54.820069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ea683-062c-4de7-bceb-a64b10cce0f4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:54.828057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef019-a4b2-411a-8a23-985c9b7de0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:54.828832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef019-a4b2-411a-8a23-985c9b7de0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.829212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef019-a4b2-411a-8a23-985c9b7de0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.829504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef019-a4b2-411a-8a23-985c9b7de0c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d89ea683-062c-4de7-bceb-a64b10cce0f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:54.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:54.833823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:54.834897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 475/945] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:54.839713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94146d7-573d-4ca4-beb8-e3f9f548bee2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.839999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94146d7-573d-4ca4-beb8-e3f9f548bee2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.840277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94146d7-573d-4ca4-beb8-e3f9f548bee2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.840397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef019-a4b2-411a-8a23-985c9b7de0c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:54.841716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef019-a4b2-411a-8a23-985c9b7de0c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:54.844454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 476/946] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:54 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:54.846565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94146d7-573d-4ca4-beb8-e3f9f548bee2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0a8ef019-a4b2-411a-8a23-985c9b7de0c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:54.857488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:54.858516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:54.859404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:54.860510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 471/947] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:54.861944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644a81-9961-45c5-8fc3-275631e6f8be None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:54.863465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644a81-9961-45c5-8fc3-275631e6f8be None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:54.863465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef644a81-9961-45c5-8fc3-275631e6f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:54.881336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ef644a81-9961-45c5-8fc3-275631e6f8be None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:54.882786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ef644a81-9961-45c5-8fc3-275631e6f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:54.922756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:54.964439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 472/948] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:54 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:54.965563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef644a81-9961-45c5-8fc3-275631e6f8be None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:54.972513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94146d7-573d-4ca4-beb8-e3f9f548bee2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:54.997361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:55.014585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:55.015220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.015509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.015792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.016519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:55.016827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:55.018905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:55.046309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 477/949] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:54 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:55.046309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:55.087285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef644a81-9961-45c5-8fc3-275631e6f8be None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:55.132126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:55.133640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.134140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.134599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.135543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:55.136020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:55.138082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:55.152532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 473/950] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:55.159315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:55.172147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e232-9755-42d7-ad9a-6a500a27181d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:55.205095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:55.225868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:55.226846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.227299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.227817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.229142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:55.230733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:55.242956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:55.244224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:55.245150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:55.247479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 478/951] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:55.254423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:55.270550 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:55.287962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39fc0-9ce6-44b6-8f35-360ecafe6a5f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:55.337731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:55.338471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.338752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.339030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/1037da4d8e26461abaed2fb3fce7e81d/roles/a5f19542263c4e1abfa302e875ffe7ca` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.341419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=1037da4d8e26461abaed2fb3fce7e81d, role_id=a5f19542263c4e1abfa302e875ffe7ca)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:55.342869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:55.364714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 474/952] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:50:55 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/1037da4d8e26461abaed2fb3fce7e81d/roles/a5f19542263c4e1abfa302e875ffe7ca => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 16:50:55.393629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f26f7-31d3-4584-80f9-59274ca7ad32 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:55.434801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:55.435459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.435759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.436076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.436790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:55.437144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:55.438691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:55.445301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 479/953] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:55 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:55.455000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:55.568812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985e23-0c75-42f6-931c-ef739111fd30 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:55.605513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b02df7-f83f-48ad-adcd-3210ff108803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:55.606711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02df7-f83f-48ad-adcd-3210ff108803 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.607278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02df7-f83f-48ad-adcd-3210ff108803 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.607753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b02df7-f83f-48ad-adcd-3210ff108803 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.608628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b02df7-f83f-48ad-adcd-3210ff108803 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:55.609127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b02df7-f83f-48ad-adcd-3210ff108803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:55.610719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b02df7-f83f-48ad-adcd-3210ff108803 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:55.620721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 475/954] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:55 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:55.622350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:55.674553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:55.733228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25e68b-2c78-4c0e-92f8-cf05abd6b199 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:55.770120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8b450-4119-49b2-8464-ea99416eb024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:55.771256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b450-4119-49b2-8464-ea99416eb024 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.771761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b450-4119-49b2-8464-ea99416eb024 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.772252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8b450-4119-49b2-8464-ea99416eb024 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.773185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8b450-4119-49b2-8464-ea99416eb024 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:55.774785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8b450-4119-49b2-8464-ea99416eb024 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:55.796704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 480/955] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:50:55 2022] POST /identity/v3/endpoints => generated 351 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:55.997461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f1bb-b1a6-41a6-a74e-2a4ade8b6c4e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:55.997793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f1bb-b1a6-41a6-a74e-2a4ade8b6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:55.998021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467f1bb-b1a6-41a6-a74e-2a4ade8b6c4e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:55.999649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 476/956] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:56.005927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47abf-690e-4d5b-b476-8dcc9be8749a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:56.006587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47abf-690e-4d5b-b476-8dcc9be8749a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:56.006871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47abf-690e-4d5b-b476-8dcc9be8749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:56.028141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b5b47abf-690e-4d5b-b476-8dcc9be8749a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:56.030908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b5b47abf-690e-4d5b-b476-8dcc9be8749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:56.128102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 481/957] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:56 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:56.153753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467f1bb-b1a6-41a6-a74e-2a4ade8b6c4e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:56.184871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:56.295516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467f1bb-b1a6-41a6-a74e-2a4ade8b6c4e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:56.333673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:56.334362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:56.334652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:56.334933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:56.335569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:56.336948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:56.346726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:56.347952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:56.348844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 477/958] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:56.357286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47abf-690e-4d5b-b476-8dcc9be8749a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:56.393843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:56.470405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47abf-690e-4d5b-b476-8dcc9be8749a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:56.509285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892b13c-f195-47d3-9291-ce92977dd735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:56.509926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b13c-f195-47d3-9291-ce92977dd735 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:56.510211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b13c-f195-47d3-9291-ce92977dd735 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:56.510519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b13c-f195-47d3-9291-ce92977dd735 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:56.511379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892b13c-f195-47d3-9291-ce92977dd735 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:56.511980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892b13c-f195-47d3-9291-ce92977dd735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:56.513702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892b13c-f195-47d3-9291-ce92977dd735 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:56.519752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 482/959] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:56 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:56.528186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:56.625389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:56.654781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c98b51-ffa0-4155-b945-71718557be39 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:56.696047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625a886-d931-4cce-8c34-29ec54a42dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:56.696766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a886-d931-4cce-8c34-29ec54a42dfe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:56.697052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a886-d931-4cce-8c34-29ec54a42dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:56.697336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a886-d931-4cce-8c34-29ec54a42dfe None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:56.698097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625a886-d931-4cce-8c34-29ec54a42dfe None admin] RBAC: Adding query filter params (type=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:56.698447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625a886-d931-4cce-8c34-29ec54a42dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:56.699916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625a886-d931-4cce-8c34-29ec54a42dfe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:56.706451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 478/960] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:50:56 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:57.424512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f927-5e01-4c08-85c0-138c7b061f58 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:57.425037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f927-5e01-4c08-85c0-138c7b061f58 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:57.425140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161f927-5e01-4c08-85c0-138c7b061f58 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:57.426792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 483/961] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:57.432674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca724-aa4a-406a-961a-5dae9897938f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:57.433228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca724-aa4a-406a-961a-5dae9897938f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:57.433228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca724-aa4a-406a-961a-5dae9897938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:57.453823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6b7ca724-aa4a-406a-961a-5dae9897938f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:57.455913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6b7ca724-aa4a-406a-961a-5dae9897938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:57.532485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 479/962] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:57 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:57.556321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f927-5e01-4c08-85c0-138c7b061f58 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:57.630007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e669d9-f4cf-4f54-af69-db008c2b47a4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:57.630441 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e669d9-f4cf-4f54-af69-db008c2b47a4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:57.630837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e669d9-f4cf-4f54-af69-db008c2b47a4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:57.632608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 480/963] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:57.638038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99cff4-9418-41ee-9dac-85ca8634052b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:57.638421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99cff4-9418-41ee-9dac-85ca8634052b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:57.638801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99cff4-9418-41ee-9dac-85ca8634052b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:57.657617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7b99cff4-9418-41ee-9dac-85ca8634052b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:57.659544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7b99cff4-9418-41ee-9dac-85ca8634052b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:57.662862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:57.672771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161f927-5e01-4c08-85c0-138c7b061f58 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:57.713062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:57.713441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:57.713727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:57.714006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:57.714826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:57.716372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:57.728833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:57.733231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.sql.core [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 16:50:57.733231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 16:50:57.733231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [parameters: {'user_id': '90b23a31214d4fa0b9121c0c4d0f90d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 16:50:57.733231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 16:50:57.738621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 481/964] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:57 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Aug 01 16:50:57.742064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:50:57.743685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application yield resource Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise self.value Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application session.commit() Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 16:50:57.744988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.flush() Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application compat.raise_( Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 16:50:57.746155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 16:50:57.747333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 16:50:57.748518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [parameters: {'user_id': '90b23a31214d4fa0b9121c0c4d0f90d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:57.749652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 16:50:57.754680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 16:50:57.755632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 16:50:57.755632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 16:50:57.755632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 16:50:57.755632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 16:50:57.755632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 16:50:57.755632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:57.755632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 484/965] 10.222.0.121 () {60 vars in 1136 bytes} [Mon Aug 1 16:50:57 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:57.756088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99cff4-9418-41ee-9dac-85ca8634052b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:57.764670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:57.869416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99cff4-9418-41ee-9dac-85ca8634052b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:57.882179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698dac1-0b8f-428b-b88e-5b1b5f03155c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:57.910000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:57.910992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:57.911481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:57.911980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:57.921879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:57.925211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:57.934320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:57.935945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:57.936744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:57.937505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:57.941767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:57.942827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:57.943774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 482/966] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:50:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:57.949066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:57.956443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:50:57.961713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:57.962978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:57.963900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 485/967] 10.222.0.121 () {56 vars in 1125 bytes} [Mon Aug 1 16:50:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:57.969208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:57.995731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.028457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.072596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8e23f-6072-4621-8218-5585a7350434 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.105857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712487f-edc9-47da-a1e9-f8627da3a8e2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.110273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcd13a-2bf3-4cb7-8389-d5cb9b9ef971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.110933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcd13a-2bf3-4cb7-8389-d5cb9b9ef971 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.111235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcd13a-2bf3-4cb7-8389-d5cb9b9ef971 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.111516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcd13a-2bf3-4cb7-8389-d5cb9b9ef971 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.112290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcd13a-2bf3-4cb7-8389-d5cb9b9ef971 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:58.112598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcd13a-2bf3-4cb7-8389-d5cb9b9ef971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.114035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcd13a-2bf3-4cb7-8389-d5cb9b9ef971 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.162288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.162514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 483/968] 10.222.0.121 () {56 vars in 1106 bytes} [Mon Aug 1 16:50:57 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:58.162643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.162643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.162643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.162854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e518-de65-4151-addc-128d62c3793b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.162854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e518-de65-4151-addc-128d62c3793b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.162854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314e518-de65-4151-addc-128d62c3793b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.163041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:58.163041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.163041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.163243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 484/969] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:58 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:58.163469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243262b5-00bf-49b5-baba-207cc03a1354 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.163733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243262b5-00bf-49b5-baba-207cc03a1354 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.164014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243262b5-00bf-49b5-baba-207cc03a1354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.183987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 486/970] 10.222.0.121 () {56 vars in 1120 bytes} [Mon Aug 1 16:50:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:58.185366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.202520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-243262b5-00bf-49b5-baba-207cc03a1354 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:58.203787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-243262b5-00bf-49b5-baba-207cc03a1354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:58.291407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 485/971] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:58 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:58.314709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.318348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243262b5-00bf-49b5-baba-207cc03a1354 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.351964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c6384-5e6f-417e-bc0f-23ade209053c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.385003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.394932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.395757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.396041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.396313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.412244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.413733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:58.435141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:58.437815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:58.438775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:58.438775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:58.438775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:58.438775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:58.438775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 487/972] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:58.440505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.468913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243262b5-00bf-49b5-baba-207cc03a1354 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.507477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.508136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.508419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.508693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.509331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.510825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:58.521484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:58.522706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:58.523552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 486/973] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:58.528438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.565241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9f250-a103-4af1-bcd8-0967e2f0b5c1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.598346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.605626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.606271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.606572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.606851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.607548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:58.607856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.609244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.622325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 488/974] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:58.628001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.652775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058c84-0adb-41dc-93dc-9d3519f1a651 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.669273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.693531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.694362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.694650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.694933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.695753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:58.696242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.697744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.708339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 487/975] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:58.709382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.749184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779dedf-4533-441d-b190-a2c65a68c6ae None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.786032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.786721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.787010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.787286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.795528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.796987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:50:58.809299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:58.810596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 16:50:58.811547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:50:58.815764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 489/976] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:50:58.817010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.843037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95ef8-baec-4fff-b53a-eb65fa8663cd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.879733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.883038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e840ca-4152-4ecf-9821-4c04d6ed17a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.883725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e840ca-4152-4ecf-9821-4c04d6ed17a5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.884002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e840ca-4152-4ecf-9821-4c04d6ed17a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.884272 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e840ca-4152-4ecf-9821-4c04d6ed17a5 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.884965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e840ca-4152-4ecf-9821-4c04d6ed17a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:58.885269 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e840ca-4152-4ecf-9821-4c04d6ed17a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.886769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e840ca-4152-4ecf-9821-4c04d6ed17a5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:58.899110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 488/977] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:58.899110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c022-8680-43c9-a051-c9226857a82f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.899110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c022-8680-43c9-a051-c9226857a82f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.899110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c022-8680-43c9-a051-c9226857a82f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.899110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 489/978] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:50:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:50:58.900606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c022-8680-43c9-a051-c9226857a82f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:58.946220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:58.951242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd05d-9e74-4c03-8063-94546b66fa4c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:58.990707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cb71f-8a0e-42df-b7fe-be5b2ef9b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:58.991382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cb71f-8a0e-42df-b7fe-be5b2ef9b90e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:58.991661 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cb71f-8a0e-42df-b7fe-be5b2ef9b90e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:58.991931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cb71f-8a0e-42df-b7fe-be5b2ef9b90e None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:58.992727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cb71f-8a0e-42df-b7fe-be5b2ef9b90e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:58.993028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cb71f-8a0e-42df-b7fe-be5b2ef9b90e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:58.994482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cb71f-8a0e-42df-b7fe-be5b2ef9b90e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.008494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c022-8680-43c9-a051-c9226857a82f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:59.013885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 490/979] 10.222.0.121 () {56 vars in 1154 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:50:59.016518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e18c8-5b6a-4d0c-84e7-9da5c95f43aa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.016800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e18c8-5b6a-4d0c-84e7-9da5c95f43aa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.017087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e18c8-5b6a-4d0c-84e7-9da5c95f43aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.035937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4f7e18c8-5b6a-4d0c-84e7-9da5c95f43aa None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:50:59.037481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4f7e18c8-5b6a-4d0c-84e7-9da5c95f43aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:50:59.045960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:59.046616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.046898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.047186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.047950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] RBAC: Adding query filter params (interface=admin, service_id=c52035db33c74030ae348e48a3a7cf5b, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:59.048254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:59.049638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.054946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 490/980] 10.222.0.121 () {56 vars in 1254 bytes} [Mon Aug 1 16:50:58 2022] GET /identity/v3/endpoints?service_id=c52035db33c74030ae348e48a3a7cf5b&interface=admin®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:59.055776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:59.106908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 491/981] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:50:59 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:50:59.107835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e18c8-5b6a-4d0c-84e7-9da5c95f43aa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:59.149028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:59.159726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570a84b-ff13-4dd9-8b62-78023323169c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:59.162229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:59.195236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:59.195877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.196158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.196432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.211278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e18c8-5b6a-4d0c-84e7-9da5c95f43aa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:59.247417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:59.248063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.248349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.248687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.249352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:59.250770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.257612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 492/982] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:50:59 2022] GET /identity/v3/services => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:50:59.258454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:59.268966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:59.270487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.401697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 491/983] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:50:59 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:50:59.404370 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:59.408177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f251d-2f7d-4ca7-bd17-ae50df605bc5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:59.410111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:59.411577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:59.463998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:59.464880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.465305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.465778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.466994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:59.469356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.498309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 493/984] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:50:59 2022] POST /identity/v3/services => generated 243 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:50:59.556449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece15f2-0eb9-4245-a10e-0d89e2530f09 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:59.602787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:59.603517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.603958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.604249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.616843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:59.618513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:50:59.635147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:59.636122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:59.637042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:50:59.637042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:50:59.637042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:50:59.637042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:59.637042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 492/985] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:59.642749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:59.755567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc5c71-8af0-4239-824e-787973201b19 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:59.791323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:59.791956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.792243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.792521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.793223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:50:59.793533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:59.794948 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.808016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 494/986] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:50:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:50:59.814254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:50:59.873771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:59.932421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd77a34-e7ee-4dec-a758-b4cd94cd5447 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:50:59.967119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:50:59.967765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:50:59.968044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:50:59.968315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:50:59.976995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:50:59.978130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:50:59.992385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:50:59.993613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:50:59.996825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 493/987] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:50:59.999873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:00.027636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:00.121247 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e6843-4ce4-48a9-8674-25afbbf395cb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:00.162676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054dbd7-606b-4037-ac5c-1faae539aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:00.163303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054dbd7-606b-4037-ac5c-1faae539aafd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:00.163580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054dbd7-606b-4037-ac5c-1faae539aafd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:00.163852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054dbd7-606b-4037-ac5c-1faae539aafd None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:00.164599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054dbd7-606b-4037-ac5c-1faae539aafd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:00.164903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054dbd7-606b-4037-ac5c-1faae539aafd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:00.166340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054dbd7-606b-4037-ac5c-1faae539aafd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:00.179116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 495/988] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:00.185017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:00.289751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d3c8-b9cb-4a21-8e62-3ba4ae1220d5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:00.305231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:00.329608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a1924-0ab8-4b28-a459-2540664c0c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:00.330607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1924-0ab8-4b28-a459-2540664c0c07 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:00.331068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1924-0ab8-4b28-a459-2540664c0c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:00.331495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a1924-0ab8-4b28-a459-2540664c0c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:00.332446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a1924-0ab8-4b28-a459-2540664c0c07 None admin] RBAC: Adding query filter params (role.id=a5f19542263c4e1abfa302e875ffe7ca, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=1037da4d8e26461abaed2fb3fce7e81d) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:00.332911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a1924-0ab8-4b28-a459-2540664c0c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:00.334538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a1924-0ab8-4b28-a459-2540664c0c07 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:00.341168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 494/989] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:00 2022] GET /identity/v3/role_assignments?user.id=1037da4d8e26461abaed2fb3fce7e81d&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=a5f19542263c4e1abfa302e875ffe7ca => generated 610 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:01.335174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6e8f-46e4-45c2-9f3d-5b3738756ca4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.336147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6e8f-46e4-45c2-9f3d-5b3738756ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.336147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6e8f-46e4-45c2-9f3d-5b3738756ca4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.337870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 496/990] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:01.342908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c47ce-d42f-4a79-a0d1-302a2c899856 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.343331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c47ce-d42f-4a79-a0d1-302a2c899856 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.343496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c47ce-d42f-4a79-a0d1-302a2c899856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.363121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c23c47ce-d42f-4a79-a0d1-302a2c899856 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:01.364357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c23c47ce-d42f-4a79-a0d1-302a2c899856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:01.434575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 495/991] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:01 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:01.457630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6e8f-46e4-45c2-9f3d-5b3738756ca4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:01.552517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:01.562147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6ee29-007f-4906-b17d-c83b624ba762 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.562496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6ee29-007f-4906-b17d-c83b624ba762 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.562743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6ee29-007f-4906-b17d-c83b624ba762 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.564094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 496/992] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:51:01.570020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72f3fc-bdb3-4149-87e9-9d52075ceab9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.570605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72f3fc-bdb3-4149-87e9-9d52075ceab9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.571052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72f3fc-bdb3-4149-87e9-9d52075ceab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.574879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6e8f-46e4-45c2-9f3d-5b3738756ca4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:01.589468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9b72f3fc-bdb3-4149-87e9-9d52075ceab9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:01.590723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9b72f3fc-bdb3-4149-87e9-9d52075ceab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:01.612113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:01.612923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.613207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.613480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.614111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:01.615508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:01.624456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:01.625454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:01.626331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 497/993] 10.222.0.121 () {56 vars in 1131 bytes} [Mon Aug 1 16:51:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:01.632292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:01.670346 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 497/994] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:01 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:01.690168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72f3fc-bdb3-4149-87e9-9d52075ceab9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:01.730186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:01.752080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b6677-575f-42c1-a69b-99c264b8496e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:01.792692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:01.793322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.793599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.793878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.794690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:01.794993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:01.796420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:01.802559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 498/995] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:51:01 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:01.804388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72f3fc-bdb3-4149-87e9-9d52075ceab9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:01.807848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:01.821566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:01.845296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:01.845881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.846278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.846511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.847088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:01.848521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:01.858403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:01.859491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:01.863385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 498/996] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:51:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:01.867129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:01.940125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2a2b8-e492-4f70-ab9b-5da68db18669 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:01.979574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:01.980617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:01.981134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:01.981610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:01.982421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:01.982883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:01.983942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:01.987055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121094e-12c7-4291-b917-c8126d20b278 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:01.987197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:01.997290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 499/997] 10.222.0.121 () {56 vars in 1127 bytes} [Mon Aug 1 16:51:01 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:02.004737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:02.025463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:02.026100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.026424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.026704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.027386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:02.027693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:02.029219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:02.039938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 499/998] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:51:01 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:02.041601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:02.110760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:02.139762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a37df5-b03e-4e2d-84bd-db217eeaab60 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:02.155292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8e63-af20-4f02-92ca-2ec78502aa15 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:02.177951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:02.178683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.178962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.179233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.179956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:02.181334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:02.195757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:02.196386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.196678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.196929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.205087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:02.205087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:02.205087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:02.206717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 500/999] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:51:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:51:02.214504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 500/1000] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:51:02 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:02.216146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:02.343824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ab20-df9a-4984-8efe-56a6c23c121e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:02.379252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:02.386363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd91e3-f4db-4539-897d-db02b1d3541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:02.386954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd91e3-f4db-4539-897d-db02b1d3541d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.387639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd91e3-f4db-4539-897d-db02b1d3541d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.388106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd91e3-f4db-4539-897d-db02b1d3541d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.388885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd91e3-f4db-4539-897d-db02b1d3541d None admin] RBAC: Adding query filter params (interface=public, service_id=7b7b23d251ed4feeb9f3027a8b9a5cb8, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:02.389199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd91e3-f4db-4539-897d-db02b1d3541d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:02.390806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd91e3-f4db-4539-897d-db02b1d3541d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:02.396921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 501/1001] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:51:02 2022] GET /identity/v3/endpoints?service_id=7b7b23d251ed4feeb9f3027a8b9a5cb8&interface=public®ion_id=RegionOne => generated 195 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:02.402631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:02.421042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe14c-1d2c-4eee-b922-1b70fade51fb None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.421598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe14c-1d2c-4eee-b922-1b70fade51fb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.421881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfe14c-1d2c-4eee-b922-1b70fade51fb None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.423435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 502/1002] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:51:02.431725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f71a1-7b1a-4ec9-a888-e0bc746d368b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.432005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f71a1-7b1a-4ec9-a888-e0bc746d368b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.432290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f71a1-7b1a-4ec9-a888-e0bc746d368b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.435116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:02.451485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-379f71a1-7b1a-4ec9-a888-e0bc746d368b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:02.452700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-379f71a1-7b1a-4ec9-a888-e0bc746d368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:02.527723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3318a4c-1f00-4b35-9e03-d1abffadb033 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:02.528901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 503/1003] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:02 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:02.551442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f71a1-7b1a-4ec9-a888-e0bc746d368b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:02.566048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:02.567078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.567366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.567648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.568311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:02.569707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:02.578116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 501/1004] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:51:02 2022] GET /identity/v3/services => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:51:02.688279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f71a1-7b1a-4ec9-a888-e0bc746d368b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:02.715715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:02.731056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:02.731718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.731995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.732325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] PATH_INFO: `/v3/services/image` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.732964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:02.734359 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:02.746356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:02.747416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:02.748263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 504/1005] 10.222.0.121 () {56 vars in 1110 bytes} [Mon Aug 1 16:51:02 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:02.753634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:02.851523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:02.865093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c4a3a-5f79-4235-85fb-ead03110737a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:02.908590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537acd0a-f1f9-483e-a817-007d8c583241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:02.909239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537acd0a-f1f9-483e-a817-007d8c583241 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:02.909522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537acd0a-f1f9-483e-a817-007d8c583241 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:02.909800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537acd0a-f1f9-483e-a817-007d8c583241 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:02.910533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537acd0a-f1f9-483e-a817-007d8c583241 None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:02.910846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537acd0a-f1f9-483e-a817-007d8c583241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:02.912217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537acd0a-f1f9-483e-a817-007d8c583241 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:02.918345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 502/1006] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:02 2022] GET /identity/v3/services?name=image => generated 123 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:02.923611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:03.031912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc30db-d417-421a-acdb-4b350905d15d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:03.070378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e98ef-88ba-4a03-9395-4feba1bcbec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:03.071004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e98ef-88ba-4a03-9395-4feba1bcbec1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:03.071282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e98ef-88ba-4a03-9395-4feba1bcbec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:03.071562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e98ef-88ba-4a03-9395-4feba1bcbec1 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:03.072257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e98ef-88ba-4a03-9395-4feba1bcbec1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:03.072563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e98ef-88ba-4a03-9395-4feba1bcbec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:03.073937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e98ef-88ba-4a03-9395-4feba1bcbec1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:03.086782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 505/1007] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:02 2022] GET /identity/v3/services?type=image => generated 123 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:04.292031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2761e54-14ef-4258-bbfa-3dcdc260dd3b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:04.292559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2761e54-14ef-4258-bbfa-3dcdc260dd3b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:04.292638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2761e54-14ef-4258-bbfa-3dcdc260dd3b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:04.294083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 503/1008] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:04.299347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69d3f7-f116-41f9-b409-4c7e6f954ecd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:04.299752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69d3f7-f116-41f9-b409-4c7e6f954ecd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:04.299917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69d3f7-f116-41f9-b409-4c7e6f954ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:04.318784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1a69d3f7-f116-41f9-b409-4c7e6f954ecd None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:04.320074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1a69d3f7-f116-41f9-b409-4c7e6f954ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:04.374165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:04.403683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 506/1009] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:04 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:04.427285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2761e54-14ef-4258-bbfa-3dcdc260dd3b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:04.536073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2761e54-14ef-4258-bbfa-3dcdc260dd3b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:04.570643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e2b5c-7843-4e1b-92ac-a3dd001a5d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:04.571207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e2b5c-7843-4e1b-92ac-a3dd001a5d7c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:04.571489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e2b5c-7843-4e1b-92ac-a3dd001a5d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:04.571765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e2b5c-7843-4e1b-92ac-a3dd001a5d7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:04.572933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e2b5c-7843-4e1b-92ac-a3dd001a5d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:04.574406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e2b5c-7843-4e1b-92ac-a3dd001a5d7c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:04.581389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 504/1010] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:04.583124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69d3f7-f116-41f9-b409-4c7e6f954ecd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:04.641892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923574-0399-460f-9dad-9d1c03026862 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:04.642187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923574-0399-460f-9dad-9d1c03026862 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:04.643026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923574-0399-460f-9dad-9d1c03026862 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:04.644386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 505/1011] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:51:04.649646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2dc51-609f-4e2b-8804-d4dd20e70708 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:04.649938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2dc51-609f-4e2b-8804-d4dd20e70708 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:04.650222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2dc51-609f-4e2b-8804-d4dd20e70708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:04.669255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d9a2dc51-609f-4e2b-8804-d4dd20e70708 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:04.670486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d9a2dc51-609f-4e2b-8804-d4dd20e70708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:04.689511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:04.699895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69d3f7-f116-41f9-b409-4c7e6f954ecd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:04.739129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:04.739770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:04.740055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:04.740337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:04.741174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:04.742591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:04.745954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 506/1012] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:04 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:04.770518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2dc51-609f-4e2b-8804-d4dd20e70708 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:04.777946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 507/1013] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:51:04 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:04.906000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2dc51-609f-4e2b-8804-d4dd20e70708 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:04.949540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb8af1-3bba-4a8c-ac6e-bbd19c2083fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:04.950193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8af1-3bba-4a8c-ac6e-bbd19c2083fb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:04.950511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8af1-3bba-4a8c-ac6e-bbd19c2083fb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:04.950794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8af1-3bba-4a8c-ac6e-bbd19c2083fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:04.951478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb8af1-3bba-4a8c-ac6e-bbd19c2083fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:04.952857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb8af1-3bba-4a8c-ac6e-bbd19c2083fb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5acb8af1-3bba-4a8c-ac6e-bbd19c2083fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:04.962196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:04.963227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:04.964086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 507/1014] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:51:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:04.969365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:05.011476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:05.095181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff08ee-f937-49e5-bffb-416cc9f01ecb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:05.102618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaff91-2949-44ce-8dc5-19279ee2bb93 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:05.102949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaff91-2949-44ce-8dc5-19279ee2bb93 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:05.103229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaff91-2949-44ce-8dc5-19279ee2bb93 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:05.104747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 508/1015] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:51:05.109739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310e30d-f927-4b1e-a1a5-c02c7206371b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:05.110095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310e30d-f927-4b1e-a1a5-c02c7206371b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:05.110380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310e30d-f927-4b1e-a1a5-c02c7206371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:05.130134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0310e30d-f927-4b1e-a1a5-c02c7206371b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:05.131490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0310e30d-f927-4b1e-a1a5-c02c7206371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:05.136210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:05.136892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:05.137122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:05.137646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:05.138377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:05.138761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:05.140140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:05.150666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 508/1016] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:51:04 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:05.150851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:05.152727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:05.212745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 509/1017] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:05 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:05.235045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310e30d-f927-4b1e-a1a5-c02c7206371b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:05.265609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:05.270139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798be80-4125-4924-ac47-d1965b8b57ea None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:05.322956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:05.323601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:05.323857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:05.324135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:05.324829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:05.325138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:05.326540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:05.332117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 509/1018] 10.222.0.121 () {56 vars in 1117 bytes} [Mon Aug 1 16:51:05 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:05.337852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:05.349574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310e30d-f927-4b1e-a1a5-c02c7206371b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:05.390665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6c93-838e-4631-bd50-c98a2d4f176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:05.391230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6c93-838e-4631-bd50-c98a2d4f176e None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:05.391484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6c93-838e-4631-bd50-c98a2d4f176e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:05.391867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6c93-838e-4631-bd50-c98a2d4f176e None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:05.393193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca6c93-838e-4631-bd50-c98a2d4f176e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:05.394575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca6c93-838e-4631-bd50-c98a2d4f176e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:05.412755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 510/1019] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:51:05 2022] POST /identity/v3/services => generated 243 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:51:05.455831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b0c91-bb51-43bd-905c-3a1f31a0d07d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:05.505763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa837252-8f64-47a2-9e59-e576784a4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:05.506451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837252-8f64-47a2-9e59-e576784a4e99 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:05.506734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837252-8f64-47a2-9e59-e576784a4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:05.507007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa837252-8f64-47a2-9e59-e576784a4e99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:05.507758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa837252-8f64-47a2-9e59-e576784a4e99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:05.509194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa837252-8f64-47a2-9e59-e576784a4e99 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:05.541904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 510/1020] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:51:05 2022] POST /identity/v3/endpoints => generated 336 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:51:06.899525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b9d3-fb0b-4f52-82ad-7d20289cab9a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:06.900060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b9d3-fb0b-4f52-82ad-7d20289cab9a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:06.900060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b9d3-fb0b-4f52-82ad-7d20289cab9a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:06.901612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 511/1021] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:06.906799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9885c4-bd1c-40b1-8e23-58e3bdb0452c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:06.907236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9885c4-bd1c-40b1-8e23-58e3bdb0452c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:06.907458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9885c4-bd1c-40b1-8e23-58e3bdb0452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:06.927029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9a9885c4-bd1c-40b1-8e23-58e3bdb0452c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:06.928250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9a9885c4-bd1c-40b1-8e23-58e3bdb0452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:06.939009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:07.020591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 511/1022] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:06 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:07.045305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b9d3-fb0b-4f52-82ad-7d20289cab9a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:07.057477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:07.159133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b9d3-fb0b-4f52-82ad-7d20289cab9a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:07.195516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387a43f-46b3-4fd7-b1ac-79653f8ef38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:07.196198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a43f-46b3-4fd7-b1ac-79653f8ef38d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.196482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a43f-46b3-4fd7-b1ac-79653f8ef38d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.196760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a43f-46b3-4fd7-b1ac-79653f8ef38d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.197941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387a43f-46b3-4fd7-b1ac-79653f8ef38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:07.199412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387a43f-46b3-4fd7-b1ac-79653f8ef38d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:07.205758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 512/1023] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:07.207345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9885c4-bd1c-40b1-8e23-58e3bdb0452c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:07.318047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9885c4-bd1c-40b1-8e23-58e3bdb0452c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:07.357223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fdfec-c918-4296-9a45-2111efbb8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:07.357866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fdfec-c918-4296-9a45-2111efbb8500 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.358155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fdfec-c918-4296-9a45-2111efbb8500 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.358460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fdfec-c918-4296-9a45-2111efbb8500 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.359168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fdfec-c918-4296-9a45-2111efbb8500 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:07.360619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fdfec-c918-4296-9a45-2111efbb8500 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:07.373576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:07.398293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 512/1024] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:51:07 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:51:07.491058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d1b8-650d-402c-a541-ba2325a99b47 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.491344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d1b8-650d-402c-a541-ba2325a99b47 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.491624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d1b8-650d-402c-a541-ba2325a99b47 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.492991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 513/1025] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:07.499524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e03902-106e-41c2-9a22-4941bc7a2c47 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.499846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e03902-106e-41c2-9a22-4941bc7a2c47 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.500129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e03902-106e-41c2-9a22-4941bc7a2c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.520453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-80e03902-106e-41c2-9a22-4941bc7a2c47 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:07.521680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-80e03902-106e-41c2-9a22-4941bc7a2c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:07.594827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 513/1026] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:07 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:07.617080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d1b8-650d-402c-a541-ba2325a99b47 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:07.701702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:07.722460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0554aa-de27-4de7-8979-7bcfd9203df0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.722815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0554aa-de27-4de7-8979-7bcfd9203df0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.723041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0554aa-de27-4de7-8979-7bcfd9203df0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.724415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 514/1027] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:51:07.727157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d1b8-650d-402c-a541-ba2325a99b47 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:07.729696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b352291-a04f-49f7-873f-cfb107afa25a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.729984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b352291-a04f-49f7-873f-cfb107afa25a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.730301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b352291-a04f-49f7-873f-cfb107afa25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.749436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8b352291-a04f-49f7-873f-cfb107afa25a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:07.750595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8b352291-a04f-49f7-873f-cfb107afa25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:07.776182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:07.776795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.777073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.777516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] PATH_INFO: `/v3/services/image` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.777961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:07.779354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:07.789131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:07.790115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:07.791312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 514/1028] 10.222.0.121 () {56 vars in 1110 bytes} [Mon Aug 1 16:51:07 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:07.796264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:07.828303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 515/1029] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:07 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:07.851575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b352291-a04f-49f7-873f-cfb107afa25a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:07.912176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf022875-fbab-4e67-90cb-396af0c8534b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:07.916898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:07.947339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:07.947964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:07.948243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:07.948512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:07.949178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:07.949481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:07.950868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:07.956943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 515/1030] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:07 2022] GET /identity/v3/services?name=image => generated 123 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:07.962568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:07.966649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b352291-a04f-49f7-873f-cfb107afa25a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:07.966812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:08.004804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.005372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.005650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.005921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.020904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:08.025883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:08.026856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:08.027702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 516/1031] 10.222.0.121 () {56 vars in 1125 bytes} [Mon Aug 1 16:51:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:08.033070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:08.079429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2682dc-6d3c-405e-a660-dccb5e89e055 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.119386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.120029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.120304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.120586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.121282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:08.121566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.122961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.128255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 516/1032] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:07 2022] GET /identity/v3/services?type=image => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:08.134436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:08.144135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1c47-be89-4e68-99c8-4356527ecfec None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.162299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:08.181718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.182374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.182663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.182931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.183653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:08.183958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.185826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.194897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 517/1033] 10.222.0.121 () {56 vars in 1120 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:08.200757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:08.211837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:08.249018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f0ebc-f248-43a4-849e-4ed1bcdd9cd6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.287489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.288029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.288311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.288583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.289442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] RBAC: Adding query filter params (interface=public, service_id=bd52232f1bd24bc992af605809b8ad24, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:08.289752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.291244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.296685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 517/1034] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/endpoints?service_id=bd52232f1bd24bc992af605809b8ad24&interface=public®ion_id=RegionOne => generated 195 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:08.302553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:08.305187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37e56e-8580-4007-b261-40e17a5240b0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.342808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.343504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.343794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.344075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.355490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.356936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:08.371828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:08.372716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:08.373602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:51:08.373602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:08.373602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:08.373602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:08.373602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 518/1035] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:08.378763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:08.407394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe486b0-429d-4f8a-8e9c-e72db846e9bf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.409651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:08.439468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:08.445048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.445673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.445953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.446237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.446908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.448263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.462844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 518/1036] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/services => generated 1966 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:51:08.495298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786933c-6754-48d1-8b61-e6f82cfd7cab None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.537643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.538202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.538519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.538803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.539518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:08.539841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.541225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.554971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 519/1037] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:08.560474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:08.674610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5d58f-ad97-4b47-84c9-f6b7539d6073 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.714925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.715733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.716442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.716442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.725018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.726642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:51:08.739120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:08.740215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:51:08.741364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:08.747594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 519/1038] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:08.748790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:08.848253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:08.860492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf68d6-908d-42ea-9780-ab0b7fbe0e5b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:08.905224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:08.905865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:08.906150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:08.906455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:08.907258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:08.907568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:08.909603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:08.928179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 520/1039] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:08.933761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:09.016540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:09.072133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdee00-b9c6-4db3-971c-887b2a712924 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:09.113015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:09.113764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:09.114355 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:09.114938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:09.213440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:09.215025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:09.278598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:09.329155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 520/1040] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:08 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:09.331271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:09.438433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c082-5779-4228-95da-3bd51f6a03dc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:09.476120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a385f6d-7766-4459-8ef4-d02dc0a810bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:09.476764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a385f6d-7766-4459-8ef4-d02dc0a810bf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:09.477045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a385f6d-7766-4459-8ef4-d02dc0a810bf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:09.477317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a385f6d-7766-4459-8ef4-d02dc0a810bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:09.488005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a385f6d-7766-4459-8ef4-d02dc0a810bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:09.489454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a385f6d-7766-4459-8ef4-d02dc0a810bf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:09.499077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8a385f6d-7766-4459-8ef4-d02dc0a810bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:09.507067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:09.508155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:09.509339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:51:09.509339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:09.509339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:09.509339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:09.516181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 521/1041] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:09.518059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:09.580859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909cff-e4ff-4b89-aca4-386598a9909b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:09.581250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909cff-e4ff-4b89-aca4-386598a9909b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:09.581726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909cff-e4ff-4b89-aca4-386598a9909b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:09.583270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 522/1042] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:09.588213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b5f52-88f8-490a-aea0-e3f3d3b4f2c5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:09.588515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b5f52-88f8-490a-aea0-e3f3d3b4f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:09.588802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b5f52-88f8-490a-aea0-e3f3d3b4f2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:09.607048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d95b5f52-88f8-490a-aea0-e3f3d3b4f2c5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:09.608250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d95b5f52-88f8-490a-aea0-e3f3d3b4f2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:09.631179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f92184-989e-4089-8a68-f1803d7f2eb9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:09.671256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:09.671889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:09.672175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:09.672462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:09.673150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:09.674018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:09.675419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:09.686911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 521/1043] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:51:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:09.687905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 523/1044] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:09 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:09.695489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:09.713664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:09.714446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b5f52-88f8-490a-aea0-e3f3d3b4f2c5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:09.805543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b033b11-4f2d-4605-befa-7916d2fd0ec1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:09.824338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b5f52-88f8-490a-aea0-e3f3d3b4f2c5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:09.842336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:09.843084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:09.843436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:09.843781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:09.851249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:09.852760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:09.857403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:09.864289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:51:09.864430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:09.865557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:51:09.866756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:09.867288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:09.872246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:09.872375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 522/1045] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:51:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:09.872495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:09.873239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:09.885111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:09.893181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:09.894360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:09.895444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:09.897108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 524/1046] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:09.902876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:09.959423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:09.999998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23133f-29b9-4e2d-8d72-9a81501006de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:10.035239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2d92-8815-4305-81a4-9c7a4370ea28 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:10.045348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:10.045972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.046248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.046547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.047295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:10.047604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:10.049058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:10.061844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 523/1047] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:10.068403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:10.075768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:10.076406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.076732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.077016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.077745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:10.078055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:10.080446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:10.102372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 525/1048] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:10.103839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:10.188581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:10.234648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12a33-bca0-47d6-afa4-81b380f48630 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:10.253711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d463e-50dc-4163-93ea-25ffb5d337e8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:10.299816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:10.300799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.301276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.301744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.303115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] RBAC: Adding query filter params (role.id=a5f19542263c4e1abfa302e875ffe7ca, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fa3215124493472d89807ab5845258fb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:10.303647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:10.305973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:10.311441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579439ab-b68a-46d2-8948-4f6234a188dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:10.311707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:10.313020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579439ab-b68a-46d2-8948-4f6234a188dd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.313465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579439ab-b68a-46d2-8948-4f6234a188dd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.313960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579439ab-b68a-46d2-8948-4f6234a188dd None admin] PATH_INFO: `/v3/users/e0ad719117ff48b69b17a6c3e2f705a4` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.322689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 524/1049] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:10 2022] GET /identity/v3/role_assignments?user.id=fa3215124493472d89807ab5845258fb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=a5f19542263c4e1abfa302e875ffe7ca => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:10.338081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579439ab-b68a-46d2-8948-4f6234a188dd None admin] RBAC: Authorizing `identity:get_user(user_id=e0ad719117ff48b69b17a6c3e2f705a4)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:10.340587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579439ab-b68a-46d2-8948-4f6234a188dd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:10.346296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 526/1050] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:10 2022] GET /identity/v3/users/e0ad719117ff48b69b17a6c3e2f705a4 => generated 286 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:10.350156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:10.477238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802f327-33ea-447e-ae86-66e3dee58d7d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:10.516807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:10.517397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.517684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.517962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.605226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:10.606058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397bb83-0272-4f5a-aae5-3fef76efea40 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.606382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397bb83-0272-4f5a-aae5-3fef76efea40 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.606892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397bb83-0272-4f5a-aae5-3fef76efea40 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.608312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 527/1051] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:10.609680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:10.611402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:10.613765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144be5d-b4c3-47f2-9269-b8b3ae1bf44d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.614054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144be5d-b4c3-47f2-9269-b8b3ae1bf44d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.614361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144be5d-b4c3-47f2-9269-b8b3ae1bf44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.632351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f144be5d-b4c3-47f2-9269-b8b3ae1bf44d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:10.633545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f144be5d-b4c3-47f2-9269-b8b3ae1bf44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:10.719682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 528/1052] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:10 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:10.738519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 525/1053] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:10 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:10.747371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:10.747530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144be5d-b4c3-47f2-9269-b8b3ae1bf44d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:10.803147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:10.877411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144be5d-b4c3-47f2-9269-b8b3ae1bf44d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:10.878450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:10.882998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d732a7-b922-4ec3-bda3-4550faa7e1c5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:10.920690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:10.921314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.921595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.921875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.923101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] RBAC: Authorizing `identity:get_project(project_id=934d15ef103e431fa3a729429ab95a11)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:10.924634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:10.926360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 529/1054] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:10 2022] GET /identity/v3/projects/934d15ef103e431fa3a729429ab95a11 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:10.927563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:10.928429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:10.928893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:10.929349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:10.930177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:10.931732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:10.932499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:10.944704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:10.945960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 16:51:10.947037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:10.948249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 526/1055] 10.222.0.121 () {56 vars in 1110 bytes} [Mon Aug 1 16:51:10 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:10.954021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:11.077396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc74fe-54a2-4e26-87ba-318256f560e6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:11.082664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee957e46-11e9-40c0-af9e-24ccc5b82d1b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:11.093178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:11.116452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:11.117335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:11.117335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:11.117616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:11.118323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:11.118629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:11.122268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:11.125604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 527/1056] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:10 2022] GET /identity/v3/services?name=image => generated 123 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:11.127661 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:11.128301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:11.128578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:11.128851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:11.129720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=934d15ef103e431fa3a729429ab95a11, user.id=e0ad719117ff48b69b17a6c3e2f705a4) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:11.130025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:11.131583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:11.132070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:11.138603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 530/1057] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:10 2022] GET /identity/v3/role_assignments?user.id=e0ad719117ff48b69b17a6c3e2f705a4&scope.project.id=934d15ef103e431fa3a729429ab95a11&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:11.166789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:11.252580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7a5d-b30d-499a-8139-90897f412b80 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:11.291248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f8f1-53a6-44df-8701-6d9e48e1a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:11.291891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f8f1-53a6-44df-8701-6d9e48e1a5be None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:11.292174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f8f1-53a6-44df-8701-6d9e48e1a5be None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:11.292455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f8f1-53a6-44df-8701-6d9e48e1a5be None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:11.293156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f8f1-53a6-44df-8701-6d9e48e1a5be None admin] RBAC: Adding query filter params (type=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:11.293465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f8f1-53a6-44df-8701-6d9e48e1a5be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:11.294898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f8f1-53a6-44df-8701-6d9e48e1a5be None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:11.306439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 528/1058] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:11 2022] GET /identity/v3/services?type=image => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:11.307849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:11.417256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc1c22-4907-4544-8327-947770833e58 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:11.452858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d21d6-e53b-4caa-9d52-797acdc1ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:11.453483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d21d6-e53b-4caa-9d52-797acdc1ebe3 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:11.453766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d21d6-e53b-4caa-9d52-797acdc1ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:11.454045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d21d6-e53b-4caa-9d52-797acdc1ebe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:11.454825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d21d6-e53b-4caa-9d52-797acdc1ebe3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:11.456199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d21d6-e53b-4caa-9d52-797acdc1ebe3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:11.478904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 531/1059] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:51:11 2022] POST /identity/v3/endpoints => generated 329 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:12.420803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0c96a-ff24-4988-8828-ed374f5b0666 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:12.421329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0c96a-ff24-4988-8828-ed374f5b0666 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:12.421408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0c96a-ff24-4988-8828-ed374f5b0666 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:12.422922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 529/1060] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:12.427916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850f7d-b361-4d67-a48b-b2115778c883 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:12.428330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850f7d-b361-4d67-a48b-b2115778c883 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:12.428507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850f7d-b361-4d67-a48b-b2115778c883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:12.447130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-81850f7d-b361-4d67-a48b-b2115778c883 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:12.448327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81850f7d-b361-4d67-a48b-b2115778c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:12.471809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:12.526341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 532/1061] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:12 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:12.550592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0c96a-ff24-4988-8828-ed374f5b0666 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:12.666667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:12.690244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0c96a-ff24-4988-8828-ed374f5b0666 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:12.729470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:12.730127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:12.730554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:12.730841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:12.751963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:12.760278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:12.766708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:12.769098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 530/1062] 10.222.0.121 () {56 vars in 1125 bytes} [Mon Aug 1 16:51:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:12.777045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850f7d-b361-4d67-a48b-b2115778c883 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:12.946754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850f7d-b361-4d67-a48b-b2115778c883 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:12.993380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fd101-fef9-436d-b758-3afcaef7916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:12.994434 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd101-fef9-436d-b758-3afcaef7916c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:12.994915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd101-fef9-436d-b758-3afcaef7916c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:12.995354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fd101-fef9-436d-b758-3afcaef7916c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:12.996626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd101-fef9-436d-b758-3afcaef7916c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:12.997169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd101-fef9-436d-b758-3afcaef7916c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:12.999687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fd101-fef9-436d-b758-3afcaef7916c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:13.020552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 533/1063] 10.222.0.121 () {56 vars in 1120 bytes} [Mon Aug 1 16:51:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:13.022165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.170890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2bc1-11ad-49e2-a44e-e5331f6d0a3d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.209172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:13.209745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.210029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.210329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.214709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67158fec-ea70-428f-b2e5-ebbb3be8736b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.215076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67158fec-ea70-428f-b2e5-ebbb3be8736b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.215431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67158fec-ea70-428f-b2e5-ebbb3be8736b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.217043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 534/1064] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:13.221992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:13.223489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:13.224315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b62c2-9703-408c-b35d-696dd86951ad None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.224954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b62c2-9703-408c-b35d-696dd86951ad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.225443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b62c2-9703-408c-b35d-696dd86951ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:13.241095 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:13.242074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:13.243045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:51:13.243045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:13.243045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:13.243045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:13.244740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f92b62c2-9703-408c-b35d-696dd86951ad None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:13.246012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f92b62c2-9703-408c-b35d-696dd86951ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:13.246580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 531/1065] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:13.247932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.251844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:13.258718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:13.323121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 535/1066] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:13.346028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b62c2-9703-408c-b35d-696dd86951ad None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.378046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f8a7-ec9e-4f7d-ac35-f2196a6a3d36 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.418361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:13.418989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.419267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.419636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.420224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:13.420526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:13.421873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:13.434626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 532/1067] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:13.440058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.463126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b62c2-9703-408c-b35d-696dd86951ad None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.506024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:13.506844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.507126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.507405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.510797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:13.521135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:13.526068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:13.527209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:13.528378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 536/1068] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:13.536448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.546802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:13.556878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15a6a9-89e3-4cc7-a4a3-e7f65864b0a1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.591056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd4cd0-16a8-45a7-8bfb-b9b2a96af4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:13.591705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd4cd0-16a8-45a7-8bfb-b9b2a96af4fd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.591982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd4cd0-16a8-45a7-8bfb-b9b2a96af4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.592256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd4cd0-16a8-45a7-8bfb-b9b2a96af4fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.599897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd4cd0-16a8-45a7-8bfb-b9b2a96af4fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:13.601330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd4cd0-16a8-45a7-8bfb-b9b2a96af4fd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-27bd4cd0-16a8-45a7-8bfb-b9b2a96af4fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:51:13.613030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:13.614082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:13.615062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 533/1069] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:13.615693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63915cf-d2fd-4ee9-8db1-4aff913f235c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.615693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63915cf-d2fd-4ee9-8db1-4aff913f235c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.615922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63915cf-d2fd-4ee9-8db1-4aff913f235c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.617164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 534/1070] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:13 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:13.619867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63915cf-d2fd-4ee9-8db1-4aff913f235c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.648145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9e29-a709-499f-bb88-082e1cdff9d4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.688026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6eff-77b9-4b92-aba4-30d5bed484e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:13.688656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6eff-77b9-4b92-aba4-30d5bed484e3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.689497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6eff-77b9-4b92-aba4-30d5bed484e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.689777 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6eff-77b9-4b92-aba4-30d5bed484e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.690543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6eff-77b9-4b92-aba4-30d5bed484e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:13.690851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6eff-77b9-4b92-aba4-30d5bed484e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:13.692219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6eff-77b9-4b92-aba4-30d5bed484e3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:13.701076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 537/1071] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:13.702552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f877d-aea1-4236-96fb-c62907be3644 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.703037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f877d-aea1-4236-96fb-c62907be3644 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.703322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f877d-aea1-4236-96fb-c62907be3644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.723984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-848f877d-aea1-4236-96fb-c62907be3644 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:13.725265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-848f877d-aea1-4236-96fb-c62907be3644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:13.774234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63915cf-d2fd-4ee9-8db1-4aff913f235c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.800759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:13.808111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:13.815975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:13.816609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.816897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.817178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.817436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 538/1072] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:13.818039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:13.818402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:13.818931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f877d-aea1-4236-96fb-c62907be3644 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.820470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:13.845556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 535/1073] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:13.846727 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:13.934189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f877d-aea1-4236-96fb-c62907be3644 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.966870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae5647-5c21-4cee-b383-75046ce63627 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:13.970164 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:13.970937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:13.971221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:13.971500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] PATH_INFO: `/v3/users/e0ad719117ff48b69b17a6c3e2f705a4` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:13.972694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ad719117ff48b69b17a6c3e2f705a4)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:13.974189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:13.975790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 539/1074] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/users/e0ad719117ff48b69b17a6c3e2f705a4 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:13.976665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.002895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.003523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.003810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.004107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.045417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.053539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.072953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.074462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.082739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9d79-093e-4cd8-9b2d-89b3a6d424c2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.117956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.118635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.118922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.119204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.130578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.132036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:14.147420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:14.148582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:14.149482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:51:14.149482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:14.149482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:14.149482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:14.149482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 540/1075] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:14.149482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.180147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 536/1076] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:13 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:14.181009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.259442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618224-0882-40cd-874d-e34a0692da34 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.269906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.280784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.291612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791acd55-8d62-4847-a4bb-e114d93a7d40 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.299127 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.299775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.300052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.300327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.301516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] RBAC: Authorizing `identity:get_project(project_id=934d15ef103e431fa3a729429ab95a11)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.302968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.304646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 541/1077] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:14 2022] GET /identity/v3/projects/934d15ef103e431fa3a729429ab95a11 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:14.305406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.326660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.327587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.327932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.328218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.329068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:14.329400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.331305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.343465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 537/1078] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:14.344308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.412513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabd7fb-86a1-45f8-be44-6d70d1fdabea None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.448635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.448867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e470a-23a3-4e20-b064-c3e9e25f3716 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.449310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.449561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.449832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.460885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.462370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:14.478176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:14.479665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:14.480562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:51:14.480562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:14.480562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:14.480562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:14.480562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 542/1079] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:14.480562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.490870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.491560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.491843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.492126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11/users/e0ad719117ff48b69b17a6c3e2f705a4/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.494839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] RBAC: Authorizing `identity:create_grant(project_id=934d15ef103e431fa3a729429ab95a11, user_id=e0ad719117ff48b69b17a6c3e2f705a4, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.496311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.509673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 538/1080] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:51:14 2022] PUT /identity/v3/projects/934d15ef103e431fa3a729429ab95a11/users/e0ad719117ff48b69b17a6c3e2f705a4/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:51:14.510457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.513270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.525447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.598045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c663a9-c894-4fd6-b006-a4ba3b7237ef None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.638290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.638966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.639118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4dba0-8da8-4b52-97de-875e9488e5df None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.639264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.639535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.648137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.649637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:51:14.662402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:14.663393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:51:14.664282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:14.669297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 543/1081] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:14.669829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.691024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.691724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.692014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.692322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.693026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:14.693466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.694890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.708894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 539/1082] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:14.797215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.803657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1892dad-62f9-4b50-abfa-983df7f5bcb8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:14.844211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6ebb-cca5-4954-9413-0a3ee03556e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:14.844859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6ebb-cca5-4954-9413-0a3ee03556e8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:14.845654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6ebb-cca5-4954-9413-0a3ee03556e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:14.845929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6ebb-cca5-4954-9413-0a3ee03556e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:14.846749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6ebb-cca5-4954-9413-0a3ee03556e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:14.847056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6ebb-cca5-4954-9413-0a3ee03556e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:14.848572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6ebb-cca5-4954-9413-0a3ee03556e8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:14.868031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 544/1083] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:14.869437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:14.941577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:14.989837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525f3c0-849c-4320-831c-e9de107a4453 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:15.030759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24337f86-4dbd-4f16-94c9-23f7e6fade65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:15.031449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24337f86-4dbd-4f16-94c9-23f7e6fade65 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:15.031736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24337f86-4dbd-4f16-94c9-23f7e6fade65 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:15.032017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24337f86-4dbd-4f16-94c9-23f7e6fade65 None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fa3215124493472d89807ab5845258fb/roles/a5f19542263c4e1abfa302e875ffe7ca` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:15.034248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24337f86-4dbd-4f16-94c9-23f7e6fade65 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=fa3215124493472d89807ab5845258fb, role_id=a5f19542263c4e1abfa302e875ffe7ca)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:15.035849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24337f86-4dbd-4f16-94c9-23f7e6fade65 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:15.050166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 540/1084] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:51:14 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/fa3215124493472d89807ab5845258fb/roles/a5f19542263c4e1abfa302e875ffe7ca => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:51:16.573795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfc4c7-5dd2-47ab-98e4-8efc34d497e3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:16.574345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfc4c7-5dd2-47ab-98e4-8efc34d497e3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:16.574441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfc4c7-5dd2-47ab-98e4-8efc34d497e3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:16.575736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 545/1085] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:16.581520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6671ccd-de15-44d4-bba6-bdb276acc18a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:16.581925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6671ccd-de15-44d4-bba6-bdb276acc18a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:16.582204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6671ccd-de15-44d4-bba6-bdb276acc18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:16.600837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d6671ccd-de15-44d4-bba6-bdb276acc18a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:16.602032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6671ccd-de15-44d4-bba6-bdb276acc18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:16.667226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 541/1086] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:16 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:16.689840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfc4c7-5dd2-47ab-98e4-8efc34d497e3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:16.790837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfc4c7-5dd2-47ab-98e4-8efc34d497e3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:16.824199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:16.824765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:16.825046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:16.825322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:16.836613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:16.842183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:16.843265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:16.844269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:16.846479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 546/1087] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:16.849401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6671ccd-de15-44d4-bba6-bdb276acc18a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:16.904136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:16.953179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6671ccd-de15-44d4-bba6-bdb276acc18a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:16.987760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73238c-ca2b-4c2a-a8ea-a285d5183d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:16.988384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73238c-ca2b-4c2a-a8ea-a285d5183d5c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:16.988667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73238c-ca2b-4c2a-a8ea-a285d5183d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:16.988942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73238c-ca2b-4c2a-a8ea-a285d5183d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:16.989652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73238c-ca2b-4c2a-a8ea-a285d5183d5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:16.989957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73238c-ca2b-4c2a-a8ea-a285d5183d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:16.991362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73238c-ca2b-4c2a-a8ea-a285d5183d5c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.004319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 542/1088] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:17.005521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.025053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:17.117417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ebb68-8edf-475c-ac01-caecc6ecbf6a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.130066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee656-d40f-4aec-b0c7-2c1d008b0b2c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.130400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee656-d40f-4aec-b0c7-2c1d008b0b2c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.130689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfee656-d40f-4aec-b0c7-2c1d008b0b2c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.132047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 543/1089] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:51:17.136986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eeef7-9dad-46ee-84af-fe72f4ae8a6e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.137525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eeef7-9dad-46ee-84af-fe72f4ae8a6e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.137805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eeef7-9dad-46ee-84af-fe72f4ae8a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.154051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.154764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.155052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.155392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] PATH_INFO: `/v3/users/e0ad719117ff48b69b17a6c3e2f705a4` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.156563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ad719117ff48b69b17a6c3e2f705a4)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.156715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-401eeef7-9dad-46ee-84af-fe72f4ae8a6e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:17.158454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-401eeef7-9dad-46ee-84af-fe72f4ae8a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:17.158692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.164934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 547/1090] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/users/e0ad719117ff48b69b17a6c3e2f705a4 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:17.165889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.223577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 544/1091] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:17 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:51:17.246605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eeef7-9dad-46ee-84af-fe72f4ae8a6e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.249189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:17.264866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3d478-5ca0-44dd-b88b-6c33d7cde618 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.292274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:17.300836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.301461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.301748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.302023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.346735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eeef7-9dad-46ee-84af-fe72f4ae8a6e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.369893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.371327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.381675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.382347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.382639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.382918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.393694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:17.398634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:17.399581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:17.400418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 545/1092] 10.222.0.121 () {56 vars in 1125 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:51:17.405646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.466913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:17.483576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 548/1093] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:17.489610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.506016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262facc9-7799-4a06-8fff-0b4fee7eae6b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.508842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:17.543340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.543959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.544238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.544511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.545223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:17.545525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.546910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.555250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 546/1094] 10.222.0.121 () {56 vars in 1120 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:17.560990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.594893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e077b90-24eb-4d15-84e4-bb8746f49052 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.630803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.631378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.631656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.631939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.633097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] RBAC: Authorizing `identity:get_project(project_id=934d15ef103e431fa3a729429ab95a11)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.634548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.636488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 549/1095] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/projects/934d15ef103e431fa3a729429ab95a11 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:17.643157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.661541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d0171-3a9f-4fd5-8f29-b1faecbf1c01 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.694356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.694998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.695283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.695562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.699115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:17.706649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.708089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:17.723859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:17.724823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:17.725756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:51:17.725756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:17.725756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:17.725756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:17.725756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 547/1096] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:17.730780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:17.747574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fccb43-f6a7-4de2-9df8-d50d7c9e8cde None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.750513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:17.783373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.784372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.784681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.784961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.785760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=934d15ef103e431fa3a729429ab95a11, user.id=e0ad719117ff48b69b17a6c3e2f705a4) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:17.786074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.787570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.793505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 550/1097] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/role_assignments?user.id=e0ad719117ff48b69b17a6c3e2f705a4&scope.project.id=934d15ef103e431fa3a729429ab95a11&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:17.837341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57813c-3c65-4036-806e-8e2f355d5d42 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:17.875652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:17.876334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:17.876615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:17.876890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:17.877597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:17.877904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:17.879338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:17.897044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 548/1098] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:17.903050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:18.010136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bdf61-7fbc-46b3-a5e4-a887302810fa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:18.029067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:18.048449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:18.049101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:18.049384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:18.049662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:18.057454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:18.058920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:51:18.070205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:18.071315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:18.073657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 551/1099] 10.222.0.121 () {56 vars in 1098 bytes} [Mon Aug 1 16:51:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:18.079905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:18.165704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:18.187666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516d056-b45b-4387-8863-a8057e70404f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:18.221657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:18.222298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:18.222589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:18.222868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:18.223660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:18.223974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:18.225436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:18.242556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 549/1100] 10.222.0.121 () {56 vars in 1138 bytes} [Mon Aug 1 16:51:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:18.249524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:18.349424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba15b-4c52-4e33-b933-125e0243fe63 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:18.382915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:18.383538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:18.383819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:18.384094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:18.428852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:18.450905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:18.452349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:18.550911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 552/1101] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:18 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:18.557227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:18.656049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae5ac-4e0e-43d0-8c10-fd1084e75fc8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:18.690341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:18.690961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:18.691185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:18.691461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:18.694120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:18.702853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:18.705097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:18.725399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:18.726446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:18.727659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:51:18.727659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:18.727659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:51:18.727659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:18.727659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 550/1102] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:18.732713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:18.810337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:18.832451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1c727-c3c1-49c1-9a24-1ec7bc9872bb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:18.869204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:18.869831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:18.870113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:18.870420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:18.871113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:18.871418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:18.872775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:18.885217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 553/1103] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:51:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:18.892935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:18.992368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22ea0d-57db-4886-a789-f55a3f336a50 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:19.034778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:19.035425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:19.035707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:19.035981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:19.042525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:19.043964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:51:19.056616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:19.057605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:19.058532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 551/1104] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:19.064239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:19.164610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be45e4b-bdd5-48a0-8905-22e6d8a968ec None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:19.197789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b98357-4ef1-4956-9535-852d19685847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:19.198438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98357-4ef1-4956-9535-852d19685847 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:19.198725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98357-4ef1-4956-9535-852d19685847 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:19.199001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98357-4ef1-4956-9535-852d19685847 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:19.199751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b98357-4ef1-4956-9535-852d19685847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:19.200054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b98357-4ef1-4956-9535-852d19685847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:19.201472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b98357-4ef1-4956-9535-852d19685847 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:19.208417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:19.213751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 554/1105] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:19.220379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:19.269880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:19.319402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44349661-82be-4a47-ac86-aa690e9d71af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:19.352624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27b23b-7662-4c97-8383-fa50ebacc9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:19.353243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27b23b-7662-4c97-8383-fa50ebacc9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:19.353528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27b23b-7662-4c97-8383-fa50ebacc9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:19.353807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27b23b-7662-4c97-8383-fa50ebacc9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:19.354625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27b23b-7662-4c97-8383-fa50ebacc9e5 None admin] RBAC: Adding query filter params (role.id=a5f19542263c4e1abfa302e875ffe7ca, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=fa3215124493472d89807ab5845258fb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:19.354937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27b23b-7662-4c97-8383-fa50ebacc9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:19.356365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27b23b-7662-4c97-8383-fa50ebacc9e5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:19.362864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 552/1106] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:19 2022] GET /identity/v3/role_assignments?user.id=fa3215124493472d89807ab5845258fb&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=a5f19542263c4e1abfa302e875ffe7ca => generated 610 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:19.931233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74966-d4f5-4247-9914-4ce28eab6ba0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:19.931749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74966-d4f5-4247-9914-4ce28eab6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:19.931862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74966-d4f5-4247-9914-4ce28eab6ba0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:19.933149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 555/1107] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:19.939605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338e03e-9247-4ead-a9fa-68b07808a983 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:19.940042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338e03e-9247-4ead-a9fa-68b07808a983 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:19.940175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338e03e-9247-4ead-a9fa-68b07808a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:19.960751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f338e03e-9247-4ead-a9fa-68b07808a983 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:19.961963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f338e03e-9247-4ead-a9fa-68b07808a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:20.031694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 553/1108] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:19 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:20.060578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e74966-d4f5-4247-9914-4ce28eab6ba0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:20.191693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e74966-d4f5-4247-9914-4ce28eab6ba0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:20.227511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b36e34-977d-4ad0-9a68-975c21a4e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:20.228161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36e34-977d-4ad0-9a68-975c21a4e02c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:20.228450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36e34-977d-4ad0-9a68-975c21a4e02c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:20.228731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b36e34-977d-4ad0-9a68-975c21a4e02c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:20.229905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b36e34-977d-4ad0-9a68-975c21a4e02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:20.231368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b36e34-977d-4ad0-9a68-975c21a4e02c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:20.232973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 556/1109] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:20.238830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338e03e-9247-4ead-a9fa-68b07808a983 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:20.280446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:20.335440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338e03e-9247-4ead-a9fa-68b07808a983 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:20.368678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3def488-072b-4750-a82c-832a460b720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:20.369322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def488-072b-4750-a82c-832a460b720e None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:20.369608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def488-072b-4750-a82c-832a460b720e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:20.369881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3def488-072b-4750-a82c-832a460b720e None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:20.370602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3def488-072b-4750-a82c-832a460b720e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:20.372023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3def488-072b-4750-a82c-832a460b720e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:20.392152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 554/1110] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:51:20 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:22.484641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab645-59de-486c-b628-7712ae6d1d07 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:22.485767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab645-59de-486c-b628-7712ae6d1d07 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:22.486180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab645-59de-486c-b628-7712ae6d1d07 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:22.488530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 557/1111] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:22.493863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681b0c-2015-4c94-9019-f460e81cdb0e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:22.494528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681b0c-2015-4c94-9019-f460e81cdb0e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:22.494528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681b0c-2015-4c94-9019-f460e81cdb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:22.516111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e7681b0c-2015-4c94-9019-f460e81cdb0e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:22.517419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e7681b0c-2015-4c94-9019-f460e81cdb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:22.588538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 555/1112] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:22 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:22.613987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab645-59de-486c-b628-7712ae6d1d07 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:22.705861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:22.768169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab645-59de-486c-b628-7712ae6d1d07 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:22.820546 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:22.821270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:22.821597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:22.821917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] PATH_INFO: `/v3/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:22.823528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] RBAC: Authorizing `identity:get_role(role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:22.824981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:22.826488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 558/1113] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:22 2022] GET /identity/v3/roles/0db42c55aa904f95983cff92ac10ac3b => generated 224 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:22.836418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681b0c-2015-4c94-9019-f460e81cdb0e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:22.880105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:22.964565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681b0c-2015-4c94-9019-f460e81cdb0e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:23.000644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:23.001433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:23.001811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:23.002179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] PATH_INFO: `/v3/users/e86925c1388543299bf88d6361fb33f8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:23.016245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] RBAC: Authorizing `identity:get_user(user_id=e86925c1388543299bf88d6361fb33f8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:23.017853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:23.019790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 556/1114] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:22 2022] GET /identity/v3/users/e86925c1388543299bf88d6361fb33f8 => generated 287 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:23.028398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:23.139414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660481-728c-4b86-a7fa-439cab6e4592 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:23.174750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:23.175383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:23.175665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:23.175938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:23.178728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:23.256943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:23.258437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:23.353254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 559/1115] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:23 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:23.359221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:23.444506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:23.461190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5eb4-732b-41b8-85a3-8ad708593f5c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:23.495217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef021770-8bc0-4417-a1e0-5ecc6c4fa36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:23.495845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021770-8bc0-4417-a1e0-5ecc6c4fa36e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:23.496129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021770-8bc0-4417-a1e0-5ecc6c4fa36e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:23.496402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef021770-8bc0-4417-a1e0-5ecc6c4fa36e None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:23.497541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021770-8bc0-4417-a1e0-5ecc6c4fa36e None admin] RBAC: Authorizing `identity:get_project(project_id=934d15ef103e431fa3a729429ab95a11)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:23.499010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef021770-8bc0-4417-a1e0-5ecc6c4fa36e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:23.501267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 557/1116] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:23 2022] GET /identity/v3/projects/934d15ef103e431fa3a729429ab95a11 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:23.510046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:23.545016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:23.609537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63889402-4fb5-4dd5-a8de-b2569d7dabbb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:23.642749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b91e8-33ab-4b50-966f-6dbad6680a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:23.643355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b91e8-33ab-4b50-966f-6dbad6680a20 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:23.643633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b91e8-33ab-4b50-966f-6dbad6680a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:23.643905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b91e8-33ab-4b50-966f-6dbad6680a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:23.644681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b91e8-33ab-4b50-966f-6dbad6680a20 None admin] RBAC: Adding query filter params (role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=934d15ef103e431fa3a729429ab95a11, user.id=e86925c1388543299bf88d6361fb33f8) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:23.644988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b91e8-33ab-4b50-966f-6dbad6680a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:23.646432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b91e8-33ab-4b50-966f-6dbad6680a20 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:23.651723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 560/1117] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:23 2022] GET /identity/v3/role_assignments?user.id=e86925c1388543299bf88d6361fb33f8&scope.project.id=934d15ef103e431fa3a729429ab95a11&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 260 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:25.653770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48adae-b443-44e3-97d0-3aae49fcae2c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:25.654449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48adae-b443-44e3-97d0-3aae49fcae2c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:25.654449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48adae-b443-44e3-97d0-3aae49fcae2c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:25.655671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 558/1118] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:25.661306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723df87b-0fd5-4419-a89a-aae1694b9278 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:25.661742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723df87b-0fd5-4419-a89a-aae1694b9278 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:25.661848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723df87b-0fd5-4419-a89a-aae1694b9278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:25.680002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-723df87b-0fd5-4419-a89a-aae1694b9278 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:25.681265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-723df87b-0fd5-4419-a89a-aae1694b9278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:25.752650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 561/1119] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:25 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:25.776437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48adae-b443-44e3-97d0-3aae49fcae2c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:25.877668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48adae-b443-44e3-97d0-3aae49fcae2c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:25.915412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:25.916149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:25.916436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:25.916714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] PATH_INFO: `/v3/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:25.918394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] RBAC: Authorizing `identity:get_role(role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:25.920026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:25.921593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 559/1120] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:25 2022] GET /identity/v3/roles/0db42c55aa904f95983cff92ac10ac3b => generated 224 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:25.928313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723df87b-0fd5-4419-a89a-aae1694b9278 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:25.955882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:26.029671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723df87b-0fd5-4419-a89a-aae1694b9278 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:26.065564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:26.066220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:26.066535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:26.066817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] PATH_INFO: `/v3/users/e86925c1388543299bf88d6361fb33f8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:26.068011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] RBAC: Authorizing `identity:get_user(user_id=e86925c1388543299bf88d6361fb33f8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:26.069446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:26.071205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 562/1121] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:25 2022] GET /identity/v3/users/e86925c1388543299bf88d6361fb33f8 => generated 287 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:26.077014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:26.101329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:26.175266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72044e7c-d158-4aab-8151-fac793e4a361 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:26.208972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ea223-3dd0-40c9-a170-1b1a53d26a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:26.209616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea223-3dd0-40c9-a170-1b1a53d26a8a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:26.209903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea223-3dd0-40c9-a170-1b1a53d26a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:26.210185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ea223-3dd0-40c9-a170-1b1a53d26a8a None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:26.211372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ea223-3dd0-40c9-a170-1b1a53d26a8a None admin] RBAC: Authorizing `identity:get_project(project_id=934d15ef103e431fa3a729429ab95a11)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:26.212806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ea223-3dd0-40c9-a170-1b1a53d26a8a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:26.214503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 560/1122] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:26 2022] GET /identity/v3/projects/934d15ef103e431fa3a729429ab95a11 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:26.220590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:26.314106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:26.320410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834dd62-7988-4e25-983f-505aa66607ab None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:26.353299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be83aa-0d67-4639-a38d-289c3fa8f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:26.353965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be83aa-0d67-4639-a38d-289c3fa8f3e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:26.354249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be83aa-0d67-4639-a38d-289c3fa8f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:26.354557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be83aa-0d67-4639-a38d-289c3fa8f3e3 None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11/users/e86925c1388543299bf88d6361fb33f8/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:26.356799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be83aa-0d67-4639-a38d-289c3fa8f3e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=934d15ef103e431fa3a729429ab95a11, user_id=e86925c1388543299bf88d6361fb33f8, role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:26.358236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be83aa-0d67-4639-a38d-289c3fa8f3e3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:26.371303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 563/1123] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:51:26 2022] PUT /identity/v3/projects/934d15ef103e431fa3a729429ab95a11/users/e86925c1388543299bf88d6361fb33f8/roles/0db42c55aa904f95983cff92ac10ac3b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:51:28.351732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23a276-f4d8-4c5b-94d7-7f7edce9a8c3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.352282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23a276-f4d8-4c5b-94d7-7f7edce9a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.352282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23a276-f4d8-4c5b-94d7-7f7edce9a8c3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.353657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 561/1124] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:28.360757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c5e1b-b352-4351-abce-e8ca071f5d7c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.360757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c5e1b-b352-4351-abce-e8ca071f5d7c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.360757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c5e1b-b352-4351-abce-e8ca071f5d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.378983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3f3c5e1b-b352-4351-abce-e8ca071f5d7c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:28.380189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3f3c5e1b-b352-4351-abce-e8ca071f5d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:28.451401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 564/1125] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:28 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:28.474231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23a276-f4d8-4c5b-94d7-7f7edce9a8c3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:28.565252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:28.576576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23a276-f4d8-4c5b-94d7-7f7edce9a8c3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:28.609618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:28.610726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.611006 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.611278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] PATH_INFO: `/v3/roles/0db42c55aa904f95983cff92ac10ac3b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.612720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] RBAC: Authorizing `identity:get_role(role_id=0db42c55aa904f95983cff92ac10ac3b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:28.614084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:28.615453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 562/1126] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:28 2022] GET /identity/v3/roles/0db42c55aa904f95983cff92ac10ac3b => generated 224 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:28.621292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c5e1b-b352-4351-abce-e8ca071f5d7c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:28.704866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:28.726886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c5e1b-b352-4351-abce-e8ca071f5d7c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:28.761203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:28.761837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.762394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.762671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] PATH_INFO: `/v3/users/e86925c1388543299bf88d6361fb33f8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.763817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] RBAC: Authorizing `identity:get_user(user_id=e86925c1388543299bf88d6361fb33f8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:28.765243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:28.767005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 565/1127] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:28 2022] GET /identity/v3/users/e86925c1388543299bf88d6361fb33f8 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:28.772888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:28.870923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63ea0-1fa3-42c7-8ada-a02522a61671 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:28.909592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:28.910230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:28.910542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:28.910812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:28.937597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:28.978764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:28.980206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:29.075875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 563/1128] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:28 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:29.082124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:29.182514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4cb6a-90fa-47b1-8628-77aa6e9c4be3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:29.216881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0398c1b-d9db-494c-afa5-89da5efd7b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:29.217553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398c1b-d9db-494c-afa5-89da5efd7b65 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:29.217832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398c1b-d9db-494c-afa5-89da5efd7b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:29.218106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398c1b-d9db-494c-afa5-89da5efd7b65 None admin] PATH_INFO: `/v3/projects/934d15ef103e431fa3a729429ab95a11` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:29.219981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0398c1b-d9db-494c-afa5-89da5efd7b65 None admin] RBAC: Authorizing `identity:get_project(project_id=934d15ef103e431fa3a729429ab95a11)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:29.221460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0398c1b-d9db-494c-afa5-89da5efd7b65 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:29.223176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 566/1129] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:29 2022] GET /identity/v3/projects/934d15ef103e431fa3a729429ab95a11 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:29.229396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:29.287785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:29.329218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baab153-b887-442b-a729-e9c9d4ac862d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:29.365369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2bcf9-e857-4620-9471-2c9cb97dff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:29.366007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2bcf9-e857-4620-9471-2c9cb97dff55 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:29.366281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2bcf9-e857-4620-9471-2c9cb97dff55 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:29.366563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2bcf9-e857-4620-9471-2c9cb97dff55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:29.367372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2bcf9-e857-4620-9471-2c9cb97dff55 None admin] RBAC: Adding query filter params (role.id=0db42c55aa904f95983cff92ac10ac3b, scope.project.id=934d15ef103e431fa3a729429ab95a11, user.id=e86925c1388543299bf88d6361fb33f8) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:29.367685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2bcf9-e857-4620-9471-2c9cb97dff55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:29.369111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2bcf9-e857-4620-9471-2c9cb97dff55 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:29.374854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 564/1130] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:29 2022] GET /identity/v3/role_assignments?user.id=e86925c1388543299bf88d6361fb33f8&scope.project.id=934d15ef103e431fa3a729429ab95a11&role.id=0db42c55aa904f95983cff92ac10ac3b => generated 610 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:31.465890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17000a65-6500-49fa-861e-49c3e143d4d0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:31.466507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17000a65-6500-49fa-861e-49c3e143d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:31.466507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17000a65-6500-49fa-861e-49c3e143d4d0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:31.467914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 567/1131] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:31.474099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45900e75-890f-41ef-881a-b9363e2e4a3c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:31.474744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45900e75-890f-41ef-881a-b9363e2e4a3c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:31.474924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45900e75-890f-41ef-881a-b9363e2e4a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:31.493032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-45900e75-890f-41ef-881a-b9363e2e4a3c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:31.494228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45900e75-890f-41ef-881a-b9363e2e4a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:31.565837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 565/1132] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:31.589492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17000a65-6500-49fa-861e-49c3e143d4d0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:31.617255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:31.708448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17000a65-6500-49fa-861e-49c3e143d4d0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:31.746847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1253d9-7b3a-414c-8eff-7539facc8412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:31.747397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1253d9-7b3a-414c-8eff-7539facc8412 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:31.747677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1253d9-7b3a-414c-8eff-7539facc8412 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:31.747950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1253d9-7b3a-414c-8eff-7539facc8412 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:31.749156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1253d9-7b3a-414c-8eff-7539facc8412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:31.751165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1253d9-7b3a-414c-8eff-7539facc8412 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:31.752806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 568/1133] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:31 2022] GET /identity/v3/domains/default => generated 200 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:31.765766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45900e75-890f-41ef-881a-b9363e2e4a3c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:31.830843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:31.881714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45900e75-890f-41ef-881a-b9363e2e4a3c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:31.919425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f00241-233d-4675-96fb-03f5e5f1aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:31.920044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f00241-233d-4675-96fb-03f5e5f1aeb8 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:31.920323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f00241-233d-4675-96fb-03f5e5f1aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:31.920596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f00241-233d-4675-96fb-03f5e5f1aeb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:31.921272 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f00241-233d-4675-96fb-03f5e5f1aeb8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:31.922954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f00241-233d-4675-96fb-03f5e5f1aeb8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:31.963226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 566/1134] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:51:31 2022] POST /identity/v3/projects => generated 312 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:34.061217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238686-31dc-47ba-bba7-756e31c7d680 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:34.061820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238686-31dc-47ba-bba7-756e31c7d680 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:34.061820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238686-31dc-47ba-bba7-756e31c7d680 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:34.063174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 569/1135] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:34.068567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6f8c5-b8d6-48dc-a6ae-1e8f6c5834a1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:34.068983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6f8c5-b8d6-48dc-a6ae-1e8f6c5834a1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:34.069121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6f8c5-b8d6-48dc-a6ae-1e8f6c5834a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:34.087996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-80d6f8c5-b8d6-48dc-a6ae-1e8f6c5834a1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:34.089216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-80d6f8c5-b8d6-48dc-a6ae-1e8f6c5834a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:34.162937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 567/1136] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:34 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:34.188144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238686-31dc-47ba-bba7-756e31c7d680 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:34.291019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:34.303833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238686-31dc-47ba-bba7-756e31c7d680 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:34.338867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e21d9-004f-4d45-827e-eb2c190698a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:34.339536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e21d9-004f-4d45-827e-eb2c190698a8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:34.339826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e21d9-004f-4d45-827e-eb2c190698a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:34.340085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e21d9-004f-4d45-827e-eb2c190698a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:34.341345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e21d9-004f-4d45-827e-eb2c190698a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:34.342815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e21d9-004f-4d45-827e-eb2c190698a8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:34.345039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 570/1137] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:51:34 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:34.351035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6f8c5-b8d6-48dc-a6ae-1e8f6c5834a1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:34.389435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:34.467148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6f8c5-b8d6-48dc-a6ae-1e8f6c5834a1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:34.507945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0229a7-82b2-4a0e-80fe-524459dfe5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:34.508584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0229a7-82b2-4a0e-80fe-524459dfe5eb None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:34.508867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0229a7-82b2-4a0e-80fe-524459dfe5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:34.509144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0229a7-82b2-4a0e-80fe-524459dfe5eb None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:34.509887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0229a7-82b2-4a0e-80fe-524459dfe5eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:34.511321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0229a7-82b2-4a0e-80fe-524459dfe5eb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:34.535172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 568/1138] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:51:34 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:36.751885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90636f-b3fd-49a3-9b5c-48e076a35167 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:36.752463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90636f-b3fd-49a3-9b5c-48e076a35167 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:36.752463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90636f-b3fd-49a3-9b5c-48e076a35167 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:36.753843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 571/1139] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:36.759460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6234c-a3e0-4bbb-8388-a19cd730b12e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:36.760026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6234c-a3e0-4bbb-8388-a19cd730b12e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:36.760026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6234c-a3e0-4bbb-8388-a19cd730b12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:36.779658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-27c6234c-a3e0-4bbb-8388-a19cd730b12e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:36.780861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-27c6234c-a3e0-4bbb-8388-a19cd730b12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:36.853296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 569/1140] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:36 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:36.877501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90636f-b3fd-49a3-9b5c-48e076a35167 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:36.996159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90636f-b3fd-49a3-9b5c-48e076a35167 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:37.030894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:37.031952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:37.032230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:37.032497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:37.042518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:37.048034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:37.049409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:37.050524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 572/1141] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:37.056070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6234c-a3e0-4bbb-8388-a19cd730b12e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:37.076375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:37.154667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6234c-a3e0-4bbb-8388-a19cd730b12e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:37.188874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:37.189492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:37.189773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:37.190044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:37.190803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:37.191108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:37.192475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:37.201931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 570/1142] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:37.207820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:37.227890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:37.310945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eeec2-14e8-4d83-a709-6a7fc0a96b4d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:37.350923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:37.351640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:37.351927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:37.352207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] PATH_INFO: `/v3/users/2d3469f9329b4a13819684343add26a8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:37.367051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] RBAC: Authorizing `identity:get_user(user_id=2d3469f9329b4a13819684343add26a8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:37.368537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:37.370252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 573/1143] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:37 2022] GET /identity/v3/users/2d3469f9329b4a13819684343add26a8 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:37.376953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:37.457038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:37.475587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d8b40-9c04-411b-ba6c-cf6bff4f652c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:37.512349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:37.512976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:37.513257 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:37.513529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:37.580426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:37.581788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:37.665941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:37.688776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 571/1144] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:37 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:37.694784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:37.773697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:37.798274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e15c08-3f68-441a-b570-9b672e23fbc7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:37.832707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc812c36-296c-43bd-936a-c7fc38d77e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:37.833273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812c36-296c-43bd-936a-c7fc38d77e1e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:37.833557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812c36-296c-43bd-936a-c7fc38d77e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:37.833836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc812c36-296c-43bd-936a-c7fc38d77e1e None admin] PATH_INFO: `/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:37.835146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc812c36-296c-43bd-936a-c7fc38d77e1e None admin] RBAC: Authorizing `identity:get_project(project_id=2536f5bdfe7b45ac9dc710ab037c9ff0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:37.836573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc812c36-296c-43bd-936a-c7fc38d77e1e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:37.838623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 574/1145] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:37 2022] GET /identity/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0 => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:37.845345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:37.955486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768edaa-64a9-47e6-996c-8bf3a98e587a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:38.004901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4a19a-36d0-4c85-af1d-2d5ba6e0c64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:38.005524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4a19a-36d0-4c85-af1d-2d5ba6e0c64c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:38.005808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4a19a-36d0-4c85-af1d-2d5ba6e0c64c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:38.006083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4a19a-36d0-4c85-af1d-2d5ba6e0c64c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:38.006955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4a19a-36d0-4c85-af1d-2d5ba6e0c64c None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=2536f5bdfe7b45ac9dc710ab037c9ff0, user.id=2d3469f9329b4a13819684343add26a8) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:38.007269 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4a19a-36d0-4c85-af1d-2d5ba6e0c64c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:38.008695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4a19a-36d0-4c85-af1d-2d5ba6e0c64c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:38.014833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 572/1146] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:37 2022] GET /identity/v3/role_assignments?user.id=2d3469f9329b4a13819684343add26a8&scope.project.id=2536f5bdfe7b45ac9dc710ab037c9ff0&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:40.041918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2f83-33a2-4d50-814d-f2582d5ebfaa None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.042530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2f83-33a2-4d50-814d-f2582d5ebfaa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.042530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2f83-33a2-4d50-814d-f2582d5ebfaa None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.044009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 575/1147] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:40.049548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511e8a2-fc47-4bfe-8d02-9f2f0c7afb9b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.050030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511e8a2-fc47-4bfe-8d02-9f2f0c7afb9b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.050122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511e8a2-fc47-4bfe-8d02-9f2f0c7afb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.075470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4511e8a2-fc47-4bfe-8d02-9f2f0c7afb9b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:40.076689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4511e8a2-fc47-4bfe-8d02-9f2f0c7afb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:40.122442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:40.150673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 573/1148] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:40 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:40.175014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2f83-33a2-4d50-814d-f2582d5ebfaa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:40.278170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2f83-33a2-4d50-814d-f2582d5ebfaa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:40.318625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:40.319588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.320007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.320415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.331465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:40.336375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:40.337490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:40.338422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 576/1149] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:40.344703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511e8a2-fc47-4bfe-8d02-9f2f0c7afb9b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:40.445233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511e8a2-fc47-4bfe-8d02-9f2f0c7afb9b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:40.480739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:40.481356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.481633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.481904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.482645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:40.482943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:40.484335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:40.492363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 574/1150] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:40.498969 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:40.504267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:40.617070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d77c60-593b-4b4b-9b21-69294ca981fb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:40.653141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:40.653801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.654085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.654402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] PATH_INFO: `/v3/users/2d3469f9329b4a13819684343add26a8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.655622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] RBAC: Authorizing `identity:get_user(user_id=2d3469f9329b4a13819684343add26a8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:40.657705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:40.659384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 577/1151] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:40 2022] GET /identity/v3/users/2d3469f9329b4a13819684343add26a8 => generated 287 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:40.665410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:40.707261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:40.773971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63551-1363-4eb6-8ed1-f45829d23d22 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:40.808158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784001a-e03d-4bbc-a38c-2e9b18814ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:40.808813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784001a-e03d-4bbc-a38c-2e9b18814ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.809099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784001a-e03d-4bbc-a38c-2e9b18814ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.809385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784001a-e03d-4bbc-a38c-2e9b18814ca5 None admin] PATH_INFO: `/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.810626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784001a-e03d-4bbc-a38c-2e9b18814ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=2536f5bdfe7b45ac9dc710ab037c9ff0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:40.812068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784001a-e03d-4bbc-a38c-2e9b18814ca5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:40.814285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 575/1152] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:40 2022] GET /identity/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:40.820637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:40.903549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:40.934137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c5668-4f90-4b1f-9500-cb742cf890dd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:40.969750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bec81-6fb1-4f02-8477-b4f46b7a2321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:40.970379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bec81-6fb1-4f02-8477-b4f46b7a2321 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:40.970668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bec81-6fb1-4f02-8477-b4f46b7a2321 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:40.970951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bec81-6fb1-4f02-8477-b4f46b7a2321 None admin] PATH_INFO: `/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0/users/2d3469f9329b4a13819684343add26a8/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:40.972943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bec81-6fb1-4f02-8477-b4f46b7a2321 None admin] RBAC: Authorizing `identity:create_grant(project_id=2536f5bdfe7b45ac9dc710ab037c9ff0, user_id=2d3469f9329b4a13819684343add26a8, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:40.974627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bec81-6fb1-4f02-8477-b4f46b7a2321 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:40.990413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 578/1153] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:51:40 2022] PUT /identity/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0/users/2d3469f9329b4a13819684343add26a8/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:51:42.984011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ed5bc-3ceb-4ab8-8f0d-c35cbef0f3aa None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:42.985103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ed5bc-3ceb-4ab8-8f0d-c35cbef0f3aa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:42.985222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ed5bc-3ceb-4ab8-8f0d-c35cbef0f3aa None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:42.986521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 576/1154] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:42.991848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857dd09-e5e5-4317-80c8-444d608b722d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:42.992285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857dd09-e5e5-4317-80c8-444d608b722d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:42.992393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857dd09-e5e5-4317-80c8-444d608b722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.010959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1857dd09-e5e5-4317-80c8-444d608b722d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:43.012397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1857dd09-e5e5-4317-80c8-444d608b722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:43.080126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 579/1155] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:42 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:43.103826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ed5bc-3ceb-4ab8-8f0d-c35cbef0f3aa None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:43.207742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ed5bc-3ceb-4ab8-8f0d-c35cbef0f3aa None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:43.215540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:43.245910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:43.246596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:43.246877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:43.247154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.257664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:43.262844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:43.263962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:43.264942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 577/1156] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:43.270119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857dd09-e5e5-4317-80c8-444d608b722d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:43.329897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:43.369896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857dd09-e5e5-4317-80c8-444d608b722d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:43.405087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:43.405714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:43.405994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:43.407088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.407812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:43.408112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:43.409481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:43.418429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 580/1157] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:43.426756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:43.538366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c58c2-f594-4aaf-ba7e-cb4c1b990bb1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:43.572493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:43.573133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:43.573418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:43.573702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] PATH_INFO: `/v3/users/2d3469f9329b4a13819684343add26a8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.574886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] RBAC: Authorizing `identity:get_user(user_id=2d3469f9329b4a13819684343add26a8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:43.576317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:43.578462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 578/1158] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:43 2022] GET /identity/v3/users/2d3469f9329b4a13819684343add26a8 => generated 287 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:43.584600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:43.683896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c8a93-5af9-408c-9ae2-4713be5192ce None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:43.710533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:43.722681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:43.723306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:43.723591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:43.723869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:43.791336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:43.792706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:43.893651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 581/1159] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:43.899712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:43.932665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:43.997730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0704456-1234-4c8e-aff4-48616ea0fd8d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:44.032037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a30cee-261a-45f3-b6ef-e00b96366779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:44.032676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30cee-261a-45f3-b6ef-e00b96366779 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:44.032955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30cee-261a-45f3-b6ef-e00b96366779 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:44.033230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a30cee-261a-45f3-b6ef-e00b96366779 None admin] PATH_INFO: `/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:44.034400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a30cee-261a-45f3-b6ef-e00b96366779 None admin] RBAC: Authorizing `identity:get_project(project_id=2536f5bdfe7b45ac9dc710ab037c9ff0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:44.035832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a30cee-261a-45f3-b6ef-e00b96366779 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:44.037473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 579/1160] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:43 2022] GET /identity/v3/projects/2536f5bdfe7b45ac9dc710ab037c9ff0 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:44.043739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:44.068475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:44.144676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717be1f-2d90-4b56-9855-79b5a4eee2a6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:44.178745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fdcf9-0457-4c4b-8487-c4b102389063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:44.179366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fdcf9-0457-4c4b-8487-c4b102389063 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:44.179651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fdcf9-0457-4c4b-8487-c4b102389063 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:44.179931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fdcf9-0457-4c4b-8487-c4b102389063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:44.180726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fdcf9-0457-4c4b-8487-c4b102389063 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=2536f5bdfe7b45ac9dc710ab037c9ff0, user.id=2d3469f9329b4a13819684343add26a8) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:44.181041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fdcf9-0457-4c4b-8487-c4b102389063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:44.182506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8fdcf9-0457-4c4b-8487-c4b102389063 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:44.189177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 582/1161] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:44 2022] GET /identity/v3/role_assignments?user.id=2d3469f9329b4a13819684343add26a8&scope.project.id=2536f5bdfe7b45ac9dc710ab037c9ff0&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:46.286774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ecd9-7f07-44b5-b842-e9350efa270b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:46.287330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ecd9-7f07-44b5-b842-e9350efa270b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:46.287330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ecd9-7f07-44b5-b842-e9350efa270b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:46.288674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 580/1162] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:46.294037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe776a-ed0b-4649-afb8-7e94bca8e7ff None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:46.294518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe776a-ed0b-4649-afb8-7e94bca8e7ff None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:46.294613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe776a-ed0b-4649-afb8-7e94bca8e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:46.313112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c7fe776a-ed0b-4649-afb8-7e94bca8e7ff None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:46.314320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c7fe776a-ed0b-4649-afb8-7e94bca8e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:46.381031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 583/1163] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:46.402911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ecd9-7f07-44b5-b842-e9350efa270b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:46.505515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ecd9-7f07-44b5-b842-e9350efa270b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:46.507047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:46.541693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:46.542211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:46.542523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:46.542795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:46.613932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:46.615602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:46.716560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 581/1164] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:46 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:46.723281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe776a-ed0b-4649-afb8-7e94bca8e7ff None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:46.742236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:46.827007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe776a-ed0b-4649-afb8-7e94bca8e7ff None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:46.863464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dc55f-29a8-4f7c-bd0b-7a11de9343e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:46.864111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc55f-29a8-4f7c-bd0b-7a11de9343e0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:46.864396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc55f-29a8-4f7c-bd0b-7a11de9343e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:46.864675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc55f-29a8-4f7c-bd0b-7a11de9343e0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:46.871690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dc55f-29a8-4f7c-bd0b-7a11de9343e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:46.873141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dc55f-29a8-4f7c-bd0b-7a11de9343e0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-464dc55f-29a8-4f7c-bd0b-7a11de9343e0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:46.885541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:46.886986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:51:46.887967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 584/1165] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:51:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:46.894014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:46.896236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:46.994220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107731-eed0-40bf-b911-198ff51ab5e9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:47.027779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f0002-3ea9-44a5-b912-57a417ffed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:47.028396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f0002-3ea9-44a5-b912-57a417ffed74 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:47.028675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f0002-3ea9-44a5-b912-57a417ffed74 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:47.028944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f0002-3ea9-44a5-b912-57a417ffed74 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:47.029623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f0002-3ea9-44a5-b912-57a417ffed74 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:47.029923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f0002-3ea9-44a5-b912-57a417ffed74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:47.031309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f0002-3ea9-44a5-b912-57a417ffed74 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:47.038474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 582/1166] 10.222.0.121 () {56 vars in 1120 bytes} [Mon Aug 1 16:51:46 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:49.023477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd39-8da6-4086-9eb2-55ce63c6f307 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:49.023995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd39-8da6-4086-9eb2-55ce63c6f307 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:49.023995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ccd39-8da6-4086-9eb2-55ce63c6f307 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:49.025395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 585/1167] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:49.030529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51019f9d-deb6-4006-a79e-b1d79808082d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:49.031454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51019f9d-deb6-4006-a79e-b1d79808082d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:49.031626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51019f9d-deb6-4006-a79e-b1d79808082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:49.050030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-51019f9d-deb6-4006-a79e-b1d79808082d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:49.051266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51019f9d-deb6-4006-a79e-b1d79808082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:49.107927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:49.116248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 583/1168] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:49 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:49.138477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ccd39-8da6-4086-9eb2-55ce63c6f307 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:49.216974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:49.239601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ccd39-8da6-4086-9eb2-55ce63c6f307 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:49.271537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c5ef5-ee58-455d-a908-5d9ecfaa8cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:49.272149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5ef5-ee58-455d-a908-5d9ecfaa8cf8 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:49.272429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5ef5-ee58-455d-a908-5d9ecfaa8cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:49.272703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c5ef5-ee58-455d-a908-5d9ecfaa8cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:49.273413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5ef5-ee58-455d-a908-5d9ecfaa8cf8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:49.274800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c5ef5-ee58-455d-a908-5d9ecfaa8cf8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:49.291545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 586/1169] 10.222.0.121 () {60 vars in 1143 bytes} [Mon Aug 1 16:51:49 2022] POST /identity/v3/domains => generated 268 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:51.328347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbeda3-8b51-42f9-ac15-b7aabeec4441 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:51.328879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbeda3-8b51-42f9-ac15-b7aabeec4441 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:51.328879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbeda3-8b51-42f9-ac15-b7aabeec4441 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:51.330281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 584/1170] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:51.335734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ab96-e8ec-4c33-aa0f-2c94e87d2382 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:51.336143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ab96-e8ec-4c33-aa0f-2c94e87d2382 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:51.336294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166ab96-e8ec-4c33-aa0f-2c94e87d2382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:51.354121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3166ab96-e8ec-4c33-aa0f-2c94e87d2382 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:51.355321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3166ab96-e8ec-4c33-aa0f-2c94e87d2382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:51.419094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 587/1171] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:51.442492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbeda3-8b51-42f9-ac15-b7aabeec4441 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:51.544946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbeda3-8b51-42f9-ac15-b7aabeec4441 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:51.578648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af8fac-c1a4-49c7-a824-8b13ec8ef1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:51.579216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af8fac-c1a4-49c7-a824-8b13ec8ef1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:51.579500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af8fac-c1a4-49c7-a824-8b13ec8ef1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:51.579783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af8fac-c1a4-49c7-a824-8b13ec8ef1c3 None admin] PATH_INFO: `/v3/domains/5ab4425af5644988a11153007777af84` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:51.589842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af8fac-c1a4-49c7-a824-8b13ec8ef1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ab4425af5644988a11153007777af84)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:51.591323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af8fac-c1a4-49c7-a824-8b13ec8ef1c3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:51.592926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 585/1172] 10.222.0.121 () {56 vars in 1188 bytes} [Mon Aug 1 16:51:51 2022] GET /identity/v3/domains/5ab4425af5644988a11153007777af84 => generated 268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:51.599141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166ab96-e8ec-4c33-aa0f-2c94e87d2382 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:51.668838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:51.704270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166ab96-e8ec-4c33-aa0f-2c94e87d2382 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:51.737200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcca6b-b297-42a5-8a03-1cca7db533e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:51.737811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcca6b-b297-42a5-8a03-1cca7db533e9 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:51.738096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcca6b-b297-42a5-8a03-1cca7db533e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:51.738411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcca6b-b297-42a5-8a03-1cca7db533e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:51.739087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcca6b-b297-42a5-8a03-1cca7db533e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:51.740513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcca6b-b297-42a5-8a03-1cca7db533e9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:51.767174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 588/1173] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:51:51 2022] POST /identity/v3/projects => generated 362 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:53.778678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0c66-4904-4013-8b69-6913c194ccff None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:53.779209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0c66-4904-4013-8b69-6913c194ccff None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:53.779209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0c66-4904-4013-8b69-6913c194ccff None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:53.780592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 586/1174] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:53.786118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520ff2-194b-4dcd-8f22-df81b48b576e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:53.786580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520ff2-194b-4dcd-8f22-df81b48b576e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:53.786705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d520ff2-194b-4dcd-8f22-df81b48b576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:53.804549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9d520ff2-194b-4dcd-8f22-df81b48b576e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:53.805723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d520ff2-194b-4dcd-8f22-df81b48b576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:53.875199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 589/1175] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:53.900098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc0c66-4904-4013-8b69-6913c194ccff None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:53.973545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:54.024350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc0c66-4904-4013-8b69-6913c194ccff None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:54.073447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf7ff2-4306-4212-bc13-586e3cfd9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:54.074073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf7ff2-4306-4212-bc13-586e3cfd9217 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:54.074426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf7ff2-4306-4212-bc13-586e3cfd9217 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:54.074748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf7ff2-4306-4212-bc13-586e3cfd9217 None admin] PATH_INFO: `/v3/domains/5ab4425af5644988a11153007777af84` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:54.075988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf7ff2-4306-4212-bc13-586e3cfd9217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ab4425af5644988a11153007777af84)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:54.077422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf7ff2-4306-4212-bc13-586e3cfd9217 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:54.079067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 587/1176] 10.222.0.121 () {56 vars in 1188 bytes} [Mon Aug 1 16:51:53 2022] GET /identity/v3/domains/5ab4425af5644988a11153007777af84 => generated 268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:51:54.085103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d520ff2-194b-4dcd-8f22-df81b48b576e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:54.137431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:54.191866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d520ff2-194b-4dcd-8f22-df81b48b576e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:54.230020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497c28b-86b9-4c08-ba1c-7b073205acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:54.230677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497c28b-86b9-4c08-ba1c-7b073205acf7 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:54.230958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497c28b-86b9-4c08-ba1c-7b073205acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:54.231230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497c28b-86b9-4c08-ba1c-7b073205acf7 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:54.231927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497c28b-86b9-4c08-ba1c-7b073205acf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:54.233417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497c28b-86b9-4c08-ba1c-7b073205acf7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:54.256503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 590/1177] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:51:54 2022] POST /identity/v3/users => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:51:56.384768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb59e5-18d4-48c2-a17e-a3d120eeec67 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:56.385406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb59e5-18d4-48c2-a17e-a3d120eeec67 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:56.385406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb59e5-18d4-48c2-a17e-a3d120eeec67 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:56.387012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 588/1178] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:56.392851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f1006-062f-4ad9-8cfe-639a455a39e9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:56.393265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f1006-062f-4ad9-8cfe-639a455a39e9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:56.393438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f1006-062f-4ad9-8cfe-639a455a39e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:56.411918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd0f1006-062f-4ad9-8cfe-639a455a39e9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:56.413153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd0f1006-062f-4ad9-8cfe-639a455a39e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:56.478747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 591/1179] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:56.502450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb59e5-18d4-48c2-a17e-a3d120eeec67 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:56.601396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb59e5-18d4-48c2-a17e-a3d120eeec67 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:56.623957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:56.635395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:56.635970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:56.636250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:56.636785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:56.647925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:56.652733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:56.653878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:56.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 589/1180] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:56.660235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f1006-062f-4ad9-8cfe-639a455a39e9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:56.695584 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:56.759583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f1006-062f-4ad9-8cfe-639a455a39e9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:56.792821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:56.793436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:56.793713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:56.793990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:56.794733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:56.795035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:56.796391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:56.804224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 592/1181] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:56.810034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:56.910160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f298d2-22c7-45ee-904e-4e638de0c39c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:56.943213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:56.943849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:56.944134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:56.944408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] PATH_INFO: `/v3/users/bb3e50127a7842af8c44ed76d823b080` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:56.956972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] RBAC: Authorizing `identity:get_user(user_id=bb3e50127a7842af8c44ed76d823b080)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:56.958434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:56.960172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 590/1182] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:56 2022] GET /identity/v3/users/bb3e50127a7842af8c44ed76d823b080 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:56.965953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:57.059939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:57.064646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80200755-77c8-4238-aab3-11c685bb8101 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:57.096954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:57.097569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:57.097851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:57.098125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:57.163936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:57.165311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:57.257990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:57.263526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 593/1183] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:51:56 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:51:57.269283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:57.312496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:57.368902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae91d6-1096-4a1c-b8c8-2cc4e7393c77 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:57.401928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3d159-8c7c-4ba1-9777-90c031da9955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:57.402718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d159-8c7c-4ba1-9777-90c031da9955 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:57.402888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d159-8c7c-4ba1-9777-90c031da9955 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:57.403167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3d159-8c7c-4ba1-9777-90c031da9955 None admin] PATH_INFO: `/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:57.404336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3d159-8c7c-4ba1-9777-90c031da9955 None admin] RBAC: Authorizing `identity:get_project(project_id=a96828f3d38e4a63b8ab5d9e991e07fd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:57.406299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3d159-8c7c-4ba1-9777-90c031da9955 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:57.407969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 591/1184] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:51:57 2022] GET /identity/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:57.414253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:57.520008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd439485-9dac-4634-99e3-cc6976e95fb9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:57.554535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462c5a9-42d1-4f02-a156-9313b9742c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:57.555147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462c5a9-42d1-4f02-a156-9313b9742c2c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:57.555429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462c5a9-42d1-4f02-a156-9313b9742c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:57.555704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462c5a9-42d1-4f02-a156-9313b9742c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:57.556490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462c5a9-42d1-4f02-a156-9313b9742c2c None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=a96828f3d38e4a63b8ab5d9e991e07fd, user.id=bb3e50127a7842af8c44ed76d823b080) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:57.556797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462c5a9-42d1-4f02-a156-9313b9742c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:57.558216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462c5a9-42d1-4f02-a156-9313b9742c2c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:57.563540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 594/1185] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:51:57 2022] GET /identity/v3/role_assignments?user.id=bb3e50127a7842af8c44ed76d823b080&scope.project.id=a96828f3d38e4a63b8ab5d9e991e07fd&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:59.567762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fa167-6226-46d5-896a-82c89a7a6d1e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:59.568297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fa167-6226-46d5-896a-82c89a7a6d1e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:59.568297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fa167-6226-46d5-896a-82c89a7a6d1e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:59.569650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 592/1186] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:51:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:51:59.574898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeab80-1f05-4b8a-b131-6fb4dd8e1fbb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:59.575320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeab80-1f05-4b8a-b131-6fb4dd8e1fbb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:59.575450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeab80-1f05-4b8a-b131-6fb4dd8e1fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:59.593683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f9eeab80-1f05-4b8a-b131-6fb4dd8e1fbb None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:51:59.594890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f9eeab80-1f05-4b8a-b131-6fb4dd8e1fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:51:59.659131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:59.669572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 595/1187] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:51:59 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:51:59.692761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fa167-6226-46d5-896a-82c89a7a6d1e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:59.790534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fa167-6226-46d5-896a-82c89a7a6d1e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:59.801262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:59.823367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:59.823935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:59.824210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:59.824480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:59.834176 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:51:59.838952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:51:59.840041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:51:59.841123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 593/1188] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:51:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:51:59.846595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeab80-1f05-4b8a-b131-6fb4dd8e1fbb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:51:59.944267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeab80-1f05-4b8a-b131-6fb4dd8e1fbb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:51:59.977542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:51:59.978153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:51:59.978467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:51:59.978744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:51:59.979452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:51:59.979751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:51:59.981106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:51:59.988808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 596/1189] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:51:59 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:51:59.994618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:00.089239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab0f6a-b632-4d77-9c68-6b9da2cd4e84 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:00.121012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:00.121627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:00.121904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:00.122177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] PATH_INFO: `/v3/users/bb3e50127a7842af8c44ed76d823b080` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:00.123341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] RBAC: Authorizing `identity:get_user(user_id=bb3e50127a7842af8c44ed76d823b080)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:00.124784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:00.126353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 594/1190] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:51:59 2022] GET /identity/v3/users/bb3e50127a7842af8c44ed76d823b080 => generated 312 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:52:00.132054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:00.186423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:00.230767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf145a4-2cd1-4ef6-8f84-ed21c99e3958 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:00.265565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fed70-989a-47fa-8fcf-ecccc6d7cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:00.266192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fed70-989a-47fa-8fcf-ecccc6d7cdfa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:00.266500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fed70-989a-47fa-8fcf-ecccc6d7cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:00.266770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fed70-989a-47fa-8fcf-ecccc6d7cdfa None admin] PATH_INFO: `/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:00.267921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fed70-989a-47fa-8fcf-ecccc6d7cdfa None admin] RBAC: Authorizing `identity:get_project(project_id=a96828f3d38e4a63b8ab5d9e991e07fd)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:00.269350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fed70-989a-47fa-8fcf-ecccc6d7cdfa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:00.271028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 597/1191] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:52:00 2022] GET /identity/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:52:00.277030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:00.315890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:00.373185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca7c5-b801-4a81-899c-b898ce5e2930 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:00.406567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5fc8c-7baa-43e0-81e4-345e36bf9c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:00.407224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fc8c-7baa-43e0-81e4-345e36bf9c42 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:00.407504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fc8c-7baa-43e0-81e4-345e36bf9c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:00.407777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5fc8c-7baa-43e0-81e4-345e36bf9c42 None admin] PATH_INFO: `/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd/users/bb3e50127a7842af8c44ed76d823b080/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:00.409670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5fc8c-7baa-43e0-81e4-345e36bf9c42 None admin] RBAC: Authorizing `identity:create_grant(project_id=a96828f3d38e4a63b8ab5d9e991e07fd, user_id=bb3e50127a7842af8c44ed76d823b080, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:00.411177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5fc8c-7baa-43e0-81e4-345e36bf9c42 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:00.424042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 595/1192] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:52:00 2022] PUT /identity/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd/users/bb3e50127a7842af8c44ed76d823b080/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:52:02.419835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41c90-00cd-4c6e-b3eb-148311749124 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:02.420408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41c90-00cd-4c6e-b3eb-148311749124 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:02.420408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be41c90-00cd-4c6e-b3eb-148311749124 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:02.422243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 598/1193] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:52:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:52:02.427585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500480a-73e1-4599-89fd-9f1d949dfca5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:02.428078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500480a-73e1-4599-89fd-9f1d949dfca5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:02.428190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500480a-73e1-4599-89fd-9f1d949dfca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:02.446470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8500480a-73e1-4599-89fd-9f1d949dfca5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:52:02.447680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8500480a-73e1-4599-89fd-9f1d949dfca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:52:02.513303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 596/1194] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:52:02 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:52:02.536890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be41c90-00cd-4c6e-b3eb-148311749124 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:02.642119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be41c90-00cd-4c6e-b3eb-148311749124 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:02.664614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:02.677111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:02.677761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:02.678039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:02.678351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:02.689018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:52:02.693909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:52:02.695066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:52:02.696025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 599/1195] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:52:02.701364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500480a-73e1-4599-89fd-9f1d949dfca5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:02.729560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:02.803273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500480a-73e1-4599-89fd-9f1d949dfca5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:02.836839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:02.837460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:02.837743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:02.838019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:02.838763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:52:02.839064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:02.840431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:02.849012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 597/1196] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:52:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:52:02.854935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:02.960155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd133c7-ee1b-450b-92c6-0b4482810405 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:02.994809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:02.995517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:02.995754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:02.996036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] PATH_INFO: `/v3/users/bb3e50127a7842af8c44ed76d823b080` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:02.997242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] RBAC: Authorizing `identity:get_user(user_id=bb3e50127a7842af8c44ed76d823b080)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:02.998719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:03.000413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 600/1197] 10.222.0.121 () {56 vars in 1182 bytes} [Mon Aug 1 16:52:02 2022] GET /identity/v3/users/bb3e50127a7842af8c44ed76d823b080 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:52:03.006464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:03.099026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:03.109088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c32dd4-befa-4510-a940-6fec7f63e576 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:03.146340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:03.146976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:03.147259 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:03.147532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:03.217010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:03.219049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:03.311206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:03.322017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 598/1198] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:52:03 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:52:03.328704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:03.379620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:03.429940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3e1be-9ae8-4703-9a08-69a879537a97 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:03.463718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18f631-9996-452e-b9e9-f57d4400f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:03.464363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f631-9996-452e-b9e9-f57d4400f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:03.464643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f631-9996-452e-b9e9-f57d4400f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:03.464919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f631-9996-452e-b9e9-f57d4400f5b4 None admin] PATH_INFO: `/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:03.466060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f631-9996-452e-b9e9-f57d4400f5b4 None admin] RBAC: Authorizing `identity:get_project(project_id=a96828f3d38e4a63b8ab5d9e991e07fd)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:03.467663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f631-9996-452e-b9e9-f57d4400f5b4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:03.469271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 601/1199] 10.222.0.121 () {56 vars in 1191 bytes} [Mon Aug 1 16:52:03 2022] GET /identity/v3/projects/a96828f3d38e4a63b8ab5d9e991e07fd => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:52:03.475478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:52:03.570818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3d5de-c8f9-4d90-b466-f4a75cc5ee1b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:52:03.604193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d5959-1157-440c-b651-06207f2e89fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:52:03.604818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5959-1157-440c-b651-06207f2e89fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:52:03.605112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5959-1157-440c-b651-06207f2e89fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:52:03.605385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5959-1157-440c-b651-06207f2e89fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:52:03.606223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d5959-1157-440c-b651-06207f2e89fc None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=a96828f3d38e4a63b8ab5d9e991e07fd, user.id=bb3e50127a7842af8c44ed76d823b080) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:52:03.606561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d5959-1157-440c-b651-06207f2e89fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:52:03.607978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d5959-1157-440c-b651-06207f2e89fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:52:03.614091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 599/1200] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:52:03 2022] GET /identity/v3/role_assignments?user.id=bb3e50127a7842af8c44ed76d823b080&scope.project.id=a96828f3d38e4a63b8ab5d9e991e07fd&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:52:13.460057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=41 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:52:13.611513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=73 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:00.224079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142d66-5540-4c5b-8471-2259b96d4177 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:00.224079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142d66-5540-4c5b-8471-2259b96d4177 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:00.224079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a142d66-5540-4c5b-8471-2259b96d4177 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:00.225568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 602/1201] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:00 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:00.234147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb13e-2aa7-4e62-a492-39127ba3f26c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:00.235079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb13e-2aa7-4e62-a492-39127ba3f26c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:00.235079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb13e-2aa7-4e62-a492-39127ba3f26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:00.256627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-37ddb13e-2aa7-4e62-a492-39127ba3f26c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:00.257864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-37ddb13e-2aa7-4e62-a492-39127ba3f26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:00.357214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 600/1202] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:00 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 16:53:00.381598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142d66-5540-4c5b-8471-2259b96d4177 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:00.542474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a142d66-5540-4c5b-8471-2259b96d4177 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:00.589753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:00.591169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:00.591500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:00.591872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:00.605890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:00.608162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:00.625669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:00.626959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:00.628780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:00.628780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:00.628780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:00.628780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:00.628780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 603/1203] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:53:00.634609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb13e-2aa7-4e62-a492-39127ba3f26c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:00.800579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb13e-2aa7-4e62-a492-39127ba3f26c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:00.838884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:00.846636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a703f2-5cf6-4509-b7fa-c2bdf3abb547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:00.847327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a703f2-5cf6-4509-b7fa-c2bdf3abb547 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:00.847620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a703f2-5cf6-4509-b7fa-c2bdf3abb547 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:00.848037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a703f2-5cf6-4509-b7fa-c2bdf3abb547 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:00.848825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a703f2-5cf6-4509-b7fa-c2bdf3abb547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:00.849137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a703f2-5cf6-4509-b7fa-c2bdf3abb547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:00.851292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a703f2-5cf6-4509-b7fa-c2bdf3abb547 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:00.873472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 601/1204] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:00.876066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:00.967636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:01.032830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d4702-619b-45b4-a872-108e31b73fd3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:01.088180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38808c-b5a7-494f-942e-e4fbc78f9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:01.088864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38808c-b5a7-494f-942e-e4fbc78f9246 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:01.089218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38808c-b5a7-494f-942e-e4fbc78f9246 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:01.089523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38808c-b5a7-494f-942e-e4fbc78f9246 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:01.090381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38808c-b5a7-494f-942e-e4fbc78f9246 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:01.092137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38808c-b5a7-494f-942e-e4fbc78f9246 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:01.126306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 604/1205] 10.222.0.121 () {60 vars in 1137 bytes} [Mon Aug 1 16:53:00 2022] POST /identity/v3/users => generated 252 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:03.520528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a48c-f324-4c7a-a155-82db6d751d26 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:03.521067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a48c-f324-4c7a-a155-82db6d751d26 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:03.521067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a48c-f324-4c7a-a155-82db6d751d26 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:03.522876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 602/1206] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:03.529850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3823-6287-418e-8740-1b623e1ac046 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:03.530569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3823-6287-418e-8740-1b623e1ac046 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:03.530683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b3823-6287-418e-8740-1b623e1ac046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:03.553080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5d6b3823-6287-418e-8740-1b623e1ac046 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:03.554416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5d6b3823-6287-418e-8740-1b623e1ac046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:03.654487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 605/1207] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:03 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:03.682136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a48c-f324-4c7a-a155-82db6d751d26 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:03.826507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a48c-f324-4c7a-a155-82db6d751d26 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:03.868241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:03.869030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:03.869315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:03.869588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:03.886001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:53:03.891113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:03.892282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:03.893287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 603/1208] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:03.900854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b3823-6287-418e-8740-1b623e1ac046 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:03.952943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:04.046087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b3823-6287-418e-8740-1b623e1ac046 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:04.099431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:04.100259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:04.100766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:04.101238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:04.102382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:04.102906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:04.104940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:04.119406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 606/1209] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:53:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:04.127090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:04.185719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:04.245372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365937df-8fd7-4aec-bdaf-e8b87529f43c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:04.291163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:04.291869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:04.292182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:04.292483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:04.306012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:04.307525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:04.323382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:04.324413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:04.325444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:04.325444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:04.325444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:04.325444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:04.325444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 604/1210] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:04.331348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:04.450455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:04.454041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783f98-1f80-471e-8aab-17924188cdac None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:04.500299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:04.500954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:04.501260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:04.501567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:04.502402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:04.502698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:04.504269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:04.520325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 607/1211] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:04.526561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:04.646872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c96013-1bc5-4e13-968e-512e9ec8fd08 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:04.648849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:04.689062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:04.689918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:04.690410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:04.690758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:04.700366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:04.702110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:53:04.716299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:04.717547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:04.723499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 605/1212] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:04.725684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:04.869831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed0199-0ee3-4c69-8670-d0d7ae79160c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:04.930496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:04.931540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:04.931910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:04.933314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:04.933754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:04.934821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:04.936904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:04.962994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 608/1213] 10.222.0.121 () {56 vars in 1148 bytes} [Mon Aug 1 16:53:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:04.970150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:05.105374 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de7581-8e6f-493a-917c-8a8813fb28d7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:05.152438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:05.153280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:05.153721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:05.153923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:05.192386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:05.241596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:05.242740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:05.373274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 606/1214] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:53:04 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:53:05.379762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:05.405494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:05.510673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010cb1-da88-43ed-8bb1-c5e755b7f20a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:05.556939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:05.557708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:05.557987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:05.558335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:05.570772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:05.572445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:05.593303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:05.595396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:05.596521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:05.596521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:05.596521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:05.596521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:05.598457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 609/1215] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:05.601014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:05.671569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:05.723438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d4e80-5327-4a2e-ade3-0e0ef741f0ff None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:05.766310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:05.767065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:05.767517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:05.767869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:05.768720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:05.769081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:05.771267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:05.790635 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 607/1216] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:05.792179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:05.885967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:05.932546 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecd581-f438-4711-9806-64d8215631e6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:05.984376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:05.985333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:05.985782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:05.986207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:05.994089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:05.996395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:53:06.009944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:06.011321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:06.012733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:06.016945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 610/1217] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:53:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:06.017871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:06.155483 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfba2d-9fb4-406b-a5df-0d74f31dcf18 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:06.184604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:06.199074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd23e7d-2d21-4595-8108-f76388aae52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:06.200225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23e7d-2d21-4595-8108-f76388aae52e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:06.200511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23e7d-2d21-4595-8108-f76388aae52e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:06.200785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23e7d-2d21-4595-8108-f76388aae52e None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:06.201774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23e7d-2d21-4595-8108-f76388aae52e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:06.202084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23e7d-2d21-4595-8108-f76388aae52e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:06.203615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23e7d-2d21-4595-8108-f76388aae52e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:06.229451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 608/1218] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:06.230942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:06.370593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5ff75-fbbb-4592-9476-b1fb5156efc5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:06.416190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:06.424449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a0f64-a2c7-4daf-a837-c09e941abdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:06.425488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a0f64-a2c7-4daf-a837-c09e941abdbc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:06.426864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a0f64-a2c7-4daf-a837-c09e941abdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:06.426864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a0f64-a2c7-4daf-a837-c09e941abdbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:06.427039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a0f64-a2c7-4daf-a837-c09e941abdbc None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=9eb75b9333bf47328ac86c259b34becc) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:06.427293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a0f64-a2c7-4daf-a837-c09e941abdbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:06.428792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a0f64-a2c7-4daf-a837-c09e941abdbc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:06.438458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 611/1219] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:53:06 2022] GET /identity/v3/role_assignments?user.id=9eb75b9333bf47328ac86c259b34becc&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:08.535926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58b31-9c07-4455-a6f5-6904c0a320e3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:08.536512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58b31-9c07-4455-a6f5-6904c0a320e3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:08.536512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58b31-9c07-4455-a6f5-6904c0a320e3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:08.538044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 609/1220] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:08.544794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60ed86-83bd-4e66-b595-f6a4d2c3d5f6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:08.545372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60ed86-83bd-4e66-b595-f6a4d2c3d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:08.545485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60ed86-83bd-4e66-b595-f6a4d2c3d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:08.565799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8e60ed86-83bd-4e66-b595-f6a4d2c3d5f6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:08.567039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8e60ed86-83bd-4e66-b595-f6a4d2c3d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:08.644292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 612/1221] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:08 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:08.667091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58b31-9c07-4455-a6f5-6904c0a320e3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:08.789191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58b31-9c07-4455-a6f5-6904c0a320e3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:08.828794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:08.829500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:08.829761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:08.830080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:08.842619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:53:08.847660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:08.848794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:08.849676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 610/1222] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:53:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:08.855168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60ed86-83bd-4e66-b595-f6a4d2c3d5f6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:08.979778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60ed86-83bd-4e66-b595-f6a4d2c3d5f6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:09.006514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:09.020980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:09.021617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:09.021898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:09.022177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:09.023016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:09.023266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:09.024666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:09.035702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 613/1223] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:53:08 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:09.041505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:09.091920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:09.159291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25d458-8b7f-476a-b8c3-97aef8b8aec8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:09.200795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:09.201453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:09.201735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:09.202016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:09.213417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:09.215966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:09.231461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:09.232884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:09.233933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:09.233933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:09.233933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:09.233933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:09.233933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 611/1224] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:09.239073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:09.359719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870209f6-b61e-440f-a245-3a573dba6979 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:09.406789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:09.407557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:09.407793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:09.408008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:09.408803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:09.409154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:09.410696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:09.424484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 614/1225] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:09.433828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:09.547518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:09.556461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7dc93-1dcb-4236-9ee5-fee58deb1bfe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:09.593874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:09.594528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:09.594812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:09.595086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:09.603977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:09.604552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:53:09.617248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:09.618633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:09.619821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 612/1226] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:09.625484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:09.682399 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:09.745209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a872de-9dd5-4f7b-bb5b-f5ffb206e6b1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:09.786513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:09.787307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:09.787590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:09.787883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:09.788670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:09.788977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:09.790433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:09.815126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 615/1227] 10.222.0.121 () {56 vars in 1148 bytes} [Mon Aug 1 16:53:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:53:09.823593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:09.946138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffde40c-786e-4542-8e12-7d799a79383d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:09.988677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:09.989341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:09.989628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:09.989908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:10.003175 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:10.004771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:10.021789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:10.023292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:10.024636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:10.024636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:10.024636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:10.024636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:10.029702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:10.030119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 613/1228] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:10.141756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294adad-50fd-415d-abf4-801368ab6148 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:10.144441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:10.183985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:10.184632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:10.184961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:10.185187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:10.185897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:10.186191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:10.187698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:10.200547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 616/1229] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:53:10.206487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:10.217445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:10.340415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce721c5-c463-4b8f-8e73-b523e6645e9a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:10.376792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:10.377457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:10.377754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:10.378022 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:10.385622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:10.387694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:53:10.399942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:10.401048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:10.402130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 614/1230] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:10.407314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:10.539204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8886bbc-ff55-4b05-8217-d6fffcc1d603 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:10.576992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577c79-1963-427a-8b3c-51d3c7840943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:10.577889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577c79-1963-427a-8b3c-51d3c7840943 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:10.578419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577c79-1963-427a-8b3c-51d3c7840943 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:10.578811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577c79-1963-427a-8b3c-51d3c7840943 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:10.579838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577c79-1963-427a-8b3c-51d3c7840943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:10.580334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577c79-1963-427a-8b3c-51d3c7840943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:10.582001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577c79-1963-427a-8b3c-51d3c7840943 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:10.596001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 617/1231] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:10.603268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:10.679613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:10.725716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513f157-f9fd-446b-b9ec-18e2808ca63e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:10.767684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fdfce-f126-4e15-a392-20207209dc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:10.768419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fdfce-f126-4e15-a392-20207209dc5a None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:10.768744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fdfce-f126-4e15-a392-20207209dc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:10.769086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fdfce-f126-4e15-a392-20207209dc5a None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/9eb75b9333bf47328ac86c259b34becc/roles/6f8906aa325c40b491f8a8fc312f5139` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:10.789530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fdfce-f126-4e15-a392-20207209dc5a None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=9eb75b9333bf47328ac86c259b34becc, role_id=6f8906aa325c40b491f8a8fc312f5139)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:10.791529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fdfce-f126-4e15-a392-20207209dc5a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:10.809228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 615/1232] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:53:10 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/9eb75b9333bf47328ac86c259b34becc/roles/6f8906aa325c40b491f8a8fc312f5139 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:12.964529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b082da-3514-4671-9018-981671ddab96 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:12.965104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b082da-3514-4671-9018-981671ddab96 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:12.965201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b082da-3514-4671-9018-981671ddab96 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:12.967097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 618/1233] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:53:12.973288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6efe8-c4d9-472e-af58-f3bddace1943 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:12.973711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6efe8-c4d9-472e-af58-f3bddace1943 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:12.974132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6efe8-c4d9-472e-af58-f3bddace1943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:12.997902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0ed6efe8-c4d9-472e-af58-f3bddace1943 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:12.999158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ed6efe8-c4d9-472e-af58-f3bddace1943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:13.069622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 616/1234] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:12 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:13.094210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b082da-3514-4671-9018-981671ddab96 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:13.121049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:13.213035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b082da-3514-4671-9018-981671ddab96 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:13.255284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:13.255931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:13.256213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:13.256486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:13.268478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:53:13.273731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:13.275231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:13.276073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 619/1235] 10.222.0.121 () {56 vars in 1107 bytes} [Mon Aug 1 16:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:13.283796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6efe8-c4d9-472e-af58-f3bddace1943 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:13.347949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:13.418876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6efe8-c4d9-472e-af58-f3bddace1943 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:13.454971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:13.455603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:13.455891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:13.456170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:13.456895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:13.457202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:13.458614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:13.467623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 617/1236] 10.222.0.121 () {56 vars in 1108 bytes} [Mon Aug 1 16:53:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:13.473148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:13.574226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:13.590274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bb0fb-1741-4b41-bcd3-f901e1554e38 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:13.626874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:13.627547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:13.627807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:13.628089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:13.638666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:13.640113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:13.654892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:13.656006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:13.657309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:13.657309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:13.657309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:13.657309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:13.657309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 620/1237] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:13.662414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:13.775802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59efa11-eae6-4195-8966-e77f24932d9b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:13.787471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:13.818800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:13.819571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:13.819922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:13.820236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:13.820943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:13.821255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:13.822759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:13.835388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 618/1238] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:13.841925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:13.959557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4fe80-c5aa-41a1-928c-090cff4197a2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:13.995674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:13.996982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:13.997235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:13.997543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:14.001085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:14.008522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:14.010645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:53:14.024180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:14.025433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:14.027034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:14.031005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 621/1239] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:14.032044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:14.149894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65e0cd-77b1-4abd-b5fa-75e9f631ca3e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:14.191493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:14.192131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:14.192416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:14.192693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:14.193520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:14.193828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:14.195317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:14.215889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 619/1240] 10.222.0.121 () {56 vars in 1148 bytes} [Mon Aug 1 16:53:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:14.221871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:14.333222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71670-dd7e-4632-bd90-4c94b5133c5e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:14.376541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:14.377174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:14.377452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:14.377724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:14.448338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:14.456081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:14.457892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:14.579095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 622/1241] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:53:14 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:53:14.585421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:14.614246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:14.704621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9955-ffa0-4b46-bb2a-d2e203db97e9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:14.746958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:14.747881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:14.748218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:14.748646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:14.760543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:14.763037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:14.780531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:14.781673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:14.787379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:14.787379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:14.787379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:14.787379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:14.787379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 620/1242] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:14.789090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:14.891876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:14.900304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c3abb-9a28-4bc6-b5ab-4075038d32b9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:14.937559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:14.938292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:14.938631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:14.938937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:14.939658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:14.940007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:14.941482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:14.953775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 623/1243] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:53:14.960082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:15.043762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:15.068138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953811-42d7-4ae9-b0fa-2803ca405e7c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:15.113832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:15.115068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:15.115462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:15.115778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:15.128069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:15.129653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:53:15.151937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:15.153496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:15.154417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:15.155342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 621/1244] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:15.161380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:15.274570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c8824-81e3-4dd5-ab68-d2e5d0a2d74c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:15.314153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efb6b7-d49a-4715-99bf-5bf6df7bc84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:15.314812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb6b7-d49a-4715-99bf-5bf6df7bc84a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:15.315101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb6b7-d49a-4715-99bf-5bf6df7bc84a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:15.315375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efb6b7-d49a-4715-99bf-5bf6df7bc84a None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:15.316131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efb6b7-d49a-4715-99bf-5bf6df7bc84a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:15.316437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efb6b7-d49a-4715-99bf-5bf6df7bc84a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:15.318396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efb6b7-d49a-4715-99bf-5bf6df7bc84a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:15.332698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 624/1245] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:15.339021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:15.451880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd030-af86-4a5c-959a-d06408c3242e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:15.489388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d4a81-77a5-41ad-9675-ab84f15a8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:15.490063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4a81-77a5-41ad-9675-ab84f15a8c6f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:15.490376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4a81-77a5-41ad-9675-ab84f15a8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:15.490651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d4a81-77a5-41ad-9675-ab84f15a8c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:15.491429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4a81-77a5-41ad-9675-ab84f15a8c6f None admin] RBAC: Adding query filter params (role.id=6f8906aa325c40b491f8a8fc312f5139, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=9eb75b9333bf47328ac86c259b34becc) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:15.491771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4a81-77a5-41ad-9675-ab84f15a8c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:15.493458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d4a81-77a5-41ad-9675-ab84f15a8c6f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:15.500449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 622/1246] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:53:15 2022] GET /identity/v3/role_assignments?user.id=9eb75b9333bf47328ac86c259b34becc&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=6f8906aa325c40b491f8a8fc312f5139 => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:17.752702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466eb57-fdec-42bf-9105-0342e98b1441 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:17.753262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466eb57-fdec-42bf-9105-0342e98b1441 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:17.753262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466eb57-fdec-42bf-9105-0342e98b1441 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:17.754695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 625/1247] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:53:17.760273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f783aa-127b-42bd-9972-d5c911cd3a0a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:17.762323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f783aa-127b-42bd-9972-d5c911cd3a0a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:17.762323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f783aa-127b-42bd-9972-d5c911cd3a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:17.768613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:17.781985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-97f783aa-127b-42bd-9972-d5c911cd3a0a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:17.783290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-97f783aa-127b-42bd-9972-d5c911cd3a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:17.860000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 623/1248] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:17 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:17.886396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466eb57-fdec-42bf-9105-0342e98b1441 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:17.905817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:18.004808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466eb57-fdec-42bf-9105-0342e98b1441 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:18.044267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:18.045015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:18.045330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:18.045671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:18.057060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:53:18.062673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:18.063935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:18.065141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 626/1249] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:18.069981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f783aa-127b-42bd-9972-d5c911cd3a0a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:18.177893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f783aa-127b-42bd-9972-d5c911cd3a0a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:18.211390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:18.217233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:18.217885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:18.218195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:18.218625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:18.219353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:18.219685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:18.221129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:18.229950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 624/1250] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:53:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:18.236778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:18.323822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:18.349313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796a4c-161d-480a-914b-0b579479fe3b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:18.383877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:18.384521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:18.385046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:18.385324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:18.397020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:18.398523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:18.413605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:18.414909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:18.416063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:18.416063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:18.416063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:18.416063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:18.416063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 627/1251] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:53:18.421196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:18.532828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc77f-bcc9-4713-8169-8f7db2857831 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:18.573619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:18.574522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:18.574777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:18.574990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:18.575754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:18.576057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:18.577556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:18.593482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 625/1252] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:18.601026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:18.714212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4fae-507f-4041-bcb1-ac47e20bf25a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:18.746590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:18.756532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:18.757253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:18.757533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:18.757861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:18.767745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:18.769357 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:53:18.782628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:18.783755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:18.784821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 628/1253] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:18.789929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:18.854284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:18.907797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837162a-f6e3-42d3-a9f3-be8b80ea13ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:18.945590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:18.946285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:18.946610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:18.946950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:18.947813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:18.948170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:18.950245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:18.971298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 626/1254] 10.222.0.121 () {56 vars in 1148 bytes} [Mon Aug 1 16:53:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:18.977171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:19.093297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefcefd-95ff-4f2f-9f79-bede6bd18629 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:19.133853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:19.134524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:19.135118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:19.135426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:19.198825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:19.212372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:19.214035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:19.336216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 629/1255] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:53:18 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:53:19.344217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:19.467890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c4a4-a8e6-4ca7-a18f-411669efa97a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:19.483600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:19.513915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:19.514740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:19.515046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:19.515374 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:19.528493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:19.530699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:19.550291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:19.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:19.552419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:19.552419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:19.552419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:19.552419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:19.552419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 627/1256] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:53:19.560022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:19.669440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:19.683730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227d21d-598b-411c-84b6-abb3190b2f8f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:19.727013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:19.727612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:19.727920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:19.728269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:19.729000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:19.729301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:19.730826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:19.744225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 630/1257] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:19.750036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:19.887313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481936-cb3f-4182-b6ea-7976580f0875 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:19.922524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:19.923147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:19.923422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:19.923693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:19.930791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:19.932232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:53:19.943596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:19.944894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:19.945962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 628/1258] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 16:53:19.950752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:20.068147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db126c-3a20-4eb5-b8d0-33e67271fbf2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:20.104598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cf33c-90b5-44e8-b797-6539d7a30509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:20.105827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf33c-90b5-44e8-b797-6539d7a30509 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:20.106133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf33c-90b5-44e8-b797-6539d7a30509 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:20.106522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf33c-90b5-44e8-b797-6539d7a30509 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:20.107246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cf33c-90b5-44e8-b797-6539d7a30509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:20.107552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cf33c-90b5-44e8-b797-6539d7a30509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:20.109019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cf33c-90b5-44e8-b797-6539d7a30509 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:20.121513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 631/1259] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:20.128121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:20.157336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:20.240298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6820bcf-f74f-4edf-b04f-e0a1528c3f7c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:20.276768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805f637-b55a-44bf-a25f-8f72f578f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:20.278134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f637-b55a-44bf-a25f-8f72f578f287 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:20.278447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f637-b55a-44bf-a25f-8f72f578f287 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:20.278729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f637-b55a-44bf-a25f-8f72f578f287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:20.279603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805f637-b55a-44bf-a25f-8f72f578f287 None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=9eb75b9333bf47328ac86c259b34becc) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:20.279941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805f637-b55a-44bf-a25f-8f72f578f287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:20.281495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805f637-b55a-44bf-a25f-8f72f578f287 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:20.287898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 629/1260] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:53:20 2022] GET /identity/v3/role_assignments?user.id=9eb75b9333bf47328ac86c259b34becc&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=0b911707f2884d61bd847b72d704811f => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:22.393859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622340-1a98-490b-9c72-1e25c1ef36b0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:22.394414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622340-1a98-490b-9c72-1e25c1ef36b0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:22.394528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622340-1a98-490b-9c72-1e25c1ef36b0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:22.395822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 632/1261] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:22.400813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff09d4-fe06-49f3-9eba-5f3839ce3804 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:22.401260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff09d4-fe06-49f3-9eba-5f3839ce3804 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:22.401380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff09d4-fe06-49f3-9eba-5f3839ce3804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:22.419640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-baff09d4-fe06-49f3-9eba-5f3839ce3804 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:22.420821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-baff09d4-fe06-49f3-9eba-5f3839ce3804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:22.485844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 630/1262] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:22 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:22.508429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622340-1a98-490b-9c72-1e25c1ef36b0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:22.521732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:22.622508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622340-1a98-490b-9c72-1e25c1ef36b0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:22.658055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:22.658652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:22.658938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:22.659215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:22.669290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:53:22.674178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:22.675308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:22.676199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 633/1263] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:53:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:22.681464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff09d4-fe06-49f3-9eba-5f3839ce3804 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:22.699920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:22.781084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff09d4-fe06-49f3-9eba-5f3839ce3804 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:22.814090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:22.814742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:22.815030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:22.815310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:22.816019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:22.816325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:22.817714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:22.826141 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 631/1264] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:53:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:22.831878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:22.898785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:22.932286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0b375-9539-449f-9366-fa4ff8e42bcb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:22.968155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:22.968797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:22.969087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:22.969366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:22.979722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:22.981226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:22.999238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:23.001253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:23.003311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:23.003311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:23.003311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:23.003311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:23.003311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 634/1265] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:23.006382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:23.085137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:23.103375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49097304-0e27-4e2c-ab46-fcd36f9790d3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:23.135113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:23.135717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:23.135995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:23.136264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:23.137647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:23.137954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:23.139357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:23.150627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 632/1266] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:23.156337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:23.255494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4d7b6-8a5c-441f-a95b-42b2d76bedca None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:23.275026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:23.289671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:23.290334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:23.290621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:23.290900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:23.298099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:23.299682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:53:23.310650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:23.311732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:23.312931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 635/1267] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:23.317758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:23.412747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bb01f-ca5d-4122-92c2-d29cc376e05b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:23.445053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:23.445661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:23.445937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:23.446205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:23.447013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:23.447315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:23.448718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:23.457569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:23.466709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 633/1268] 10.222.0.121 () {56 vars in 1148 bytes} [Mon Aug 1 16:53:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:23.472666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:23.601106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb5cd-0706-410d-9b5f-6470411dc28a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:23.638403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:23.639045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:23.639330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:23.639606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:23.649786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:23.651244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:23.665156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:23.666179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:23.667531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:23.667531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:23.667531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:23.667531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:23.667531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 636/1269] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:23.672288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:23.768475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc418c-4bec-4bd8-ac76-5a26c2dddd9d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:23.800502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:23.801118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:23.801404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:23.801682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:23.802399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:23.802708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:23.804068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:23.815474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 634/1270] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:23.821021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:23.852484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:23.936323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d4114-7dfd-45be-868c-748b2574f464 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:23.968594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:23.969235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:23.969517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:23.969793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:23.976294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:23.977720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:53:23.989286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:23.990346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:23.991329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 637/1271] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:23.996861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:24.055383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:24.096087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb41f-ff59-416b-b5dd-fab757caacee None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:24.128331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a484d7-e366-4316-990c-3a4ea5e724ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:24.128880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a484d7-e366-4316-990c-3a4ea5e724ed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:24.129159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a484d7-e366-4316-990c-3a4ea5e724ed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:24.129433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a484d7-e366-4316-990c-3a4ea5e724ed None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:24.130169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a484d7-e366-4316-990c-3a4ea5e724ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:24.130617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a484d7-e366-4316-990c-3a4ea5e724ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:24.132028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a484d7-e366-4316-990c-3a4ea5e724ed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:24.143865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 635/1272] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:24.149911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:24.240107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:24.250018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61871f6f-ee13-4c43-92a6-6852c9ff9323 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:24.283538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663fc1e-1e84-4a13-8444-03fd1d6d274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:24.284202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663fc1e-1e84-4a13-8444-03fd1d6d274d None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:24.284489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663fc1e-1e84-4a13-8444-03fd1d6d274d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:24.284767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663fc1e-1e84-4a13-8444-03fd1d6d274d None admin] PATH_INFO: `/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/9eb75b9333bf47328ac86c259b34becc/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:24.286892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663fc1e-1e84-4a13-8444-03fd1d6d274d None admin] RBAC: Authorizing `identity:create_grant(project_id=3e78955e6f0d4975a9c3886a28f8b321, user_id=9eb75b9333bf47328ac86c259b34becc, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:24.288155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663fc1e-1e84-4a13-8444-03fd1d6d274d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:24.301817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 638/1273] 10.222.0.121 () {58 vars in 1444 bytes} [Mon Aug 1 16:53:24 2022] PUT /identity/v3/projects/3e78955e6f0d4975a9c3886a28f8b321/users/9eb75b9333bf47328ac86c259b34becc/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:53:26.309073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e72d-16f4-403f-b3ba-730aca1fd2ed None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.309601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e72d-16f4-403f-b3ba-730aca1fd2ed None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.309601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e72d-16f4-403f-b3ba-730aca1fd2ed None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.310995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 636/1274] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:26.316543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31e0d-430f-4e5b-915e-1d305962726a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.316972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31e0d-430f-4e5b-915e-1d305962726a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.317104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f31e0d-430f-4e5b-915e-1d305962726a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.334857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e0f31e0d-430f-4e5b-915e-1d305962726a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:26.336034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e0f31e0d-430f-4e5b-915e-1d305962726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:26.400792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 639/1275] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:26 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:26.423997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e72d-16f4-403f-b3ba-730aca1fd2ed None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.525067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e72d-16f4-403f-b3ba-730aca1fd2ed None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.545620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:26.564638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.565211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.565489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.565762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.575462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 16:53:26.580282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:26.581385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:26.582496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 637/1276] 10.222.0.121 () {56 vars in 1101 bytes} [Mon Aug 1 16:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:26.587484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31e0d-430f-4e5b-915e-1d305962726a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.672956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:26.691840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f31e0d-430f-4e5b-915e-1d305962726a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.725236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.725850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.726131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.726439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.727150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:26.727453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.728821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.737397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 640/1277] 10.222.0.121 () {56 vars in 1104 bytes} [Mon Aug 1 16:53:26 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:26.743111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:26.838378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ccac3-b0e9-4008-9105-61001b6a1840 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:26.871427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:26.872058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:26.872339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:26.872613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:26.882414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:26.883859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:26.899207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:26.900683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:26.903020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:26.903020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:26.903020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:26.903020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:26.903020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 638/1278] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:26.906717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.003272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be0b37-16df-4af2-b5ad-e02d936442d8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.036545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.037167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.037455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.037735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.038459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:27.038769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.040150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.052646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 641/1279] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:27.058251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.088302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:27.155322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48bbb3-d462-4441-9857-f1fec8d09937 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.186999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.187638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.187918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.188189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.195587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.197015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 16:53:27.208948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:27.210084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:27.211431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 639/1280] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:27.216635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.220395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:27.314224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aacd1-b04c-4f24-862c-3ccbe815aaa6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.347130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.347724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.348006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.348280 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.349066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:27.349372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.350829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.367523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 642/1281] 10.222.0.121 () {56 vars in 1148 bytes} [Mon Aug 1 16:53:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:27.373847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.462936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:27.472942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbff58-fc0e-4e4f-b188-b09730f2c485 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.506162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.507039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.507433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.507834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.580046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.581500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.666118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:27.676993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 640/1282] 10.222.0.121 () {58 vars in 1287 bytes} [Mon Aug 1 16:53:27 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 16:53:27.683102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.743852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:27.782625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9cdc3-2b60-4c8f-8447-23b319cb3eb7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:27.825698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:27.826837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:27.827334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:27.827859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:27.843117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:27.844778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 16:53:27.860523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:27.861574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:27.862813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 16:53:27.862813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 16:53:27.862813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 16:53:27.862813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:27.862813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 643/1283] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:27.867452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:27.967062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f52c1a-a995-4e8c-b1cd-c32258c030a5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.000245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.000798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.001083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.001358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.002041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.002379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.003729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.014930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 641/1284] 10.222.0.121 () {56 vars in 1114 bytes} [Mon Aug 1 16:53:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.020620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.125117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07af1e-4713-4727-8c1e-ed1401940376 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.139360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:28.159322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.159963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.160242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.160518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.166995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.168478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 16:53:28.179737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:28.180866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Aug 01 16:53:28.181858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 644/1285] 10.222.0.121 () {56 vars in 1116 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:28.187490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.238514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:28.289126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34496-589f-4e29-aed0-2379ff7bcbcb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.321282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff78b7-0397-4fde-9d8e-956b5c5e2608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.321899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff78b7-0397-4fde-9d8e-956b5c5e2608 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.322179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff78b7-0397-4fde-9d8e-956b5c5e2608 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.322487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff78b7-0397-4fde-9d8e-956b5c5e2608 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.323228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff78b7-0397-4fde-9d8e-956b5c5e2608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.324150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff78b7-0397-4fde-9d8e-956b5c5e2608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.325636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff78b7-0397-4fde-9d8e-956b5c5e2608 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.337148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 642/1286] 10.222.0.121 () {56 vars in 1153 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:28.343530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:28.442963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c7380-5cf1-473f-a307-7ee220519521 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:28.474831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb5632-7be1-4312-b58d-ee72cf0ad00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:28.475432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb5632-7be1-4312-b58d-ee72cf0ad00a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:28.475711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb5632-7be1-4312-b58d-ee72cf0ad00a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:28.475982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb5632-7be1-4312-b58d-ee72cf0ad00a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:28.476755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb5632-7be1-4312-b58d-ee72cf0ad00a None admin] RBAC: Adding query filter params (role.id=0b911707f2884d61bd847b72d704811f, scope.project.id=3e78955e6f0d4975a9c3886a28f8b321, user.id=9eb75b9333bf47328ac86c259b34becc) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:28.477059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb5632-7be1-4312-b58d-ee72cf0ad00a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:28.478491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb5632-7be1-4312-b58d-ee72cf0ad00a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:28.484648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 645/1287] 10.222.0.121 () {56 vars in 1379 bytes} [Mon Aug 1 16:53:28 2022] GET /identity/v3/role_assignments?user.id=9eb75b9333bf47328ac86c259b34becc&scope.project.id=3e78955e6f0d4975a9c3886a28f8b321&role.id=0b911707f2884d61bd847b72d704811f => generated 610 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:30.550195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b687a-3f32-4730-aaf2-2999a6143431 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.550791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b687a-3f32-4730-aaf2-2999a6143431 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.551240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b687a-3f32-4730-aaf2-2999a6143431 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.553020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 643/1288] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:30.560272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499e4d7-f0f5-495b-89be-27be65c6f89c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.560821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499e4d7-f0f5-495b-89be-27be65c6f89c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.560821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499e4d7-f0f5-495b-89be-27be65c6f89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.580538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8499e4d7-f0f5-495b-89be-27be65c6f89c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:30.581711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8499e4d7-f0f5-495b-89be-27be65c6f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:30.610935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:30.649442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 646/1289] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:30 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:30.671672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b687a-3f32-4730-aaf2-2999a6143431 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.773118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b687a-3f32-4730-aaf2-2999a6143431 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.784130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:30.807482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.808099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.808384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.808659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.809282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.810682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:30.819491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:30.820792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:30.821822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 644/1290] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:53:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:30.827217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499e4d7-f0f5-495b-89be-27be65c6f89c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:30.925041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499e4d7-f0f5-495b-89be-27be65c6f89c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:30.958403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bda9c9-e792-4d67-90f8-9396168ed972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:30.959023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda9c9-e792-4d67-90f8-9396168ed972 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:30.959309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda9c9-e792-4d67-90f8-9396168ed972 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:30.959586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bda9c9-e792-4d67-90f8-9396168ed972 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:30.960265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda9c9-e792-4d67-90f8-9396168ed972 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:30.960571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda9c9-e792-4d67-90f8-9396168ed972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:30.961942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bda9c9-e792-4d67-90f8-9396168ed972 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:30.967336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 647/1291] 10.222.0.121 () {56 vars in 1121 bytes} [Mon Aug 1 16:53:30 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:30.973097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:31.071449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7c21-681d-47d5-b826-463b91c4b29d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:31.105129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106087ed-1ddb-42e1-a88b-0e2d28de72d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:31.105741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106087ed-1ddb-42e1-a88b-0e2d28de72d2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:31.106028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106087ed-1ddb-42e1-a88b-0e2d28de72d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:31.106334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106087ed-1ddb-42e1-a88b-0e2d28de72d2 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:31.107012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106087ed-1ddb-42e1-a88b-0e2d28de72d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:31.107319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106087ed-1ddb-42e1-a88b-0e2d28de72d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:31.108692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106087ed-1ddb-42e1-a88b-0e2d28de72d2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:31.113084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 645/1292] 10.222.0.121 () {56 vars in 1121 bytes} [Mon Aug 1 16:53:30 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:33.109045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ceea5-d1e9-4adf-a991-a84586f2389b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.109604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ceea5-d1e9-4adf-a991-a84586f2389b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.109604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ceea5-d1e9-4adf-a991-a84586f2389b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.110978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 648/1293] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:33.115985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01e8b-9e1b-4556-aee4-243537215dd5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.116380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01e8b-9e1b-4556-aee4-243537215dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.116549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa01e8b-9e1b-4556-aee4-243537215dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.135112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4fa01e8b-9e1b-4556-aee4-243537215dd5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:33.136900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4fa01e8b-9e1b-4556-aee4-243537215dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:33.166629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:33.209585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 646/1294] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:33 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:33.232945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ceea5-d1e9-4adf-a991-a84586f2389b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:33.272678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:33.366908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ceea5-d1e9-4adf-a991-a84586f2389b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:33.411903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851c32-e35f-4c82-ab52-9b6b307bedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:33.412476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851c32-e35f-4c82-ab52-9b6b307bedc8 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:33.412760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851c32-e35f-4c82-ab52-9b6b307bedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:33.413036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851c32-e35f-4c82-ab52-9b6b307bedc8 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:33.413731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851c32-e35f-4c82-ab52-9b6b307bedc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:33.415130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851c32-e35f-4c82-ab52-9b6b307bedc8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:33.430609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 649/1295] 10.222.0.121 () {60 vars in 1146 bytes} [Mon Aug 1 16:53:33 2022] POST /identity/v3/services => generated 247 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:35.481285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce3efa-73b7-48f4-8470-a123bf7ca4d3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:35.481850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce3efa-73b7-48f4-8470-a123bf7ca4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:35.481850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce3efa-73b7-48f4-8470-a123bf7ca4d3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.483243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 647/1296] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:35.488502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02cc6b-8ece-49d3-8b79-b529c0dda446 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:35.488938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02cc6b-8ece-49d3-8b79-b529c0dda446 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:35.489048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02cc6b-8ece-49d3-8b79-b529c0dda446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.506925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7f02cc6b-8ece-49d3-8b79-b529c0dda446 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:35.508120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7f02cc6b-8ece-49d3-8b79-b529c0dda446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:35.596263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 650/1297] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:35 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:35.621884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce3efa-73b7-48f4-8470-a123bf7ca4d3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:35.735812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce3efa-73b7-48f4-8470-a123bf7ca4d3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:35.777626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:35.778621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:35.779129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:35.779530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.780530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:35.782049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:35.791687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:35.792975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:35.793848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 648/1298] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:53:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:35.799098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02cc6b-8ece-49d3-8b79-b529c0dda446 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:35.818360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:35.903757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02cc6b-8ece-49d3-8b79-b529c0dda446 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:35.938774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:35.939380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:35.939659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:35.940024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:35.940700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:35.941003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:35.942432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:35.947373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 651/1299] 10.222.0.121 () {56 vars in 1121 bytes} [Mon Aug 1 16:53:35 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:35.953602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:35.985442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:36.055504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769abf0-5567-4073-9b87-03bbad593c10 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:36.088513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b0f28-ee4b-467c-b76e-45cf17fb94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:36.089170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0f28-ee4b-467c-b76e-45cf17fb94da None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:36.089455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0f28-ee4b-467c-b76e-45cf17fb94da None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:36.089731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b0f28-ee4b-467c-b76e-45cf17fb94da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:36.090522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b0f28-ee4b-467c-b76e-45cf17fb94da None admin] RBAC: Adding query filter params (interface=public, service_id=1c21068a1c14450f81bc3906a486ef53, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:36.090833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b0f28-ee4b-467c-b76e-45cf17fb94da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:36.092214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b0f28-ee4b-467c-b76e-45cf17fb94da None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:36.097184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 649/1300] 10.222.0.121 () {56 vars in 1256 bytes} [Mon Aug 1 16:53:35 2022] GET /identity/v3/endpoints?service_id=1c21068a1c14450f81bc3906a486ef53&interface=public®ion_id=RegionOne => generated 195 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:36.102967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:36.187367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:36.205717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab602a99-c581-4318-8079-3bd9acdc4396 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:36.239820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31e44-7ed1-4d5a-810c-f33d4967ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:36.240448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31e44-7ed1-4d5a-810c-f33d4967ade1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:36.240728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31e44-7ed1-4d5a-810c-f33d4967ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:36.241032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31e44-7ed1-4d5a-810c-f33d4967ade1 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:36.241650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb31e44-7ed1-4d5a-810c-f33d4967ade1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:36.243042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb31e44-7ed1-4d5a-810c-f33d4967ade1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:36.250501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 652/1301] 10.222.0.121 () {56 vars in 1092 bytes} [Mon Aug 1 16:53:36 2022] GET /identity/v3/services => generated 2201 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:53:38.267954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514513cf-0cec-4e80-a822-1a0ff5f454eb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.268490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514513cf-0cec-4e80-a822-1a0ff5f454eb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.268490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514513cf-0cec-4e80-a822-1a0ff5f454eb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.269861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 650/1302] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:53:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:53:38.275106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb410-9399-476c-b30b-9c488e9373ae None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.275482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb410-9399-476c-b30b-9c488e9373ae None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.275672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb410-9399-476c-b30b-9c488e9373ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.294484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b0fcb410-9399-476c-b30b-9c488e9373ae None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:53:38.295723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b0fcb410-9399-476c-b30b-9c488e9373ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:53:38.364672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 653/1303] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:53:38 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 16:53:38.388458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514513cf-0cec-4e80-a822-1a0ff5f454eb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:38.482534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:38.489721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514513cf-0cec-4e80-a822-1a0ff5f454eb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:38.527697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:38.528304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.528560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.528838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.529479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:38.530873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 16:53:38.540284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 16:53:38.541503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Aug 01 16:53:38.543080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 651/1304] 10.222.0.121 () {56 vars in 1122 bytes} [Mon Aug 1 16:53:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 16:53:38.548487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb410-9399-476c-b30b-9c488e9373ae None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:38.624804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:38.648410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb410-9399-476c-b30b-9c488e9373ae None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:38.683092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34560d-e903-4213-8a57-6da57e5b9fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:38.683717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34560d-e903-4213-8a57-6da57e5b9fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.684001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34560d-e903-4213-8a57-6da57e5b9fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.684275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34560d-e903-4213-8a57-6da57e5b9fa5 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.684952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34560d-e903-4213-8a57-6da57e5b9fa5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:53:38.685257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34560d-e903-4213-8a57-6da57e5b9fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:38.686653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34560d-e903-4213-8a57-6da57e5b9fa5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:38.691901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 654/1305] 10.222.0.121 () {56 vars in 1121 bytes} [Mon Aug 1 16:53:38 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 16:53:38.697896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:53:38.803917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae067f6-33ab-4642-ace4-c435fa709afe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:53:38.849439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322bcde-439f-4a3c-b874-b227c7ba1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:53:38.850083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bcde-439f-4a3c-b874-b227c7ba1457 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:53:38.850396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bcde-439f-4a3c-b874-b227c7ba1457 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:53:38.850696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bcde-439f-4a3c-b874-b227c7ba1457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:53:38.851914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322bcde-439f-4a3c-b874-b227c7ba1457 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:53:38.854121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322bcde-439f-4a3c-b874-b227c7ba1457 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:53:38.875769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 652/1306] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:53:38 2022] POST /identity/v3/endpoints => generated 333 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:53:48.688780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=30 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:48.871573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:42.866020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352a47-fc92-49c9-9613-a064f73ecd12 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.867135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352a47-fc92-49c9-9613-a064f73ecd12 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.867135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46352a47-fc92-49c9-9613-a064f73ecd12 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:42.872213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 655/1307] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:54:42 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:42.873674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d16e-e9bf-4f18-ad76-c4dde8ec0324 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:42.874107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d16e-e9bf-4f18-ad76-c4dde8ec0324 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:42.874337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1d16e-e9bf-4f18-ad76-c4dde8ec0324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.059678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-23b1d16e-e9bf-4f18-ad76-c4dde8ec0324 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:43.060921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-23b1d16e-e9bf-4f18-ad76-c4dde8ec0324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.213194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 653/1308] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:54:43.265624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a951184-6dd6-4646-bb48-46979422fc58 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.266116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a951184-6dd6-4646-bb48-46979422fc58 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.266781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a951184-6dd6-4646-bb48-46979422fc58 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.268342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 656/1309] 10.222.0.121 () {54 vars in 970 bytes} [Mon Aug 1 16:54:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:43.275091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246177a-2331-43c5-bfa2-d21e14698f99 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.275409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246177a-2331-43c5-bfa2-d21e14698f99 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.275666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246177a-2331-43c5-bfa2-d21e14698f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.357373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9246177a-2331-43c5-bfa2-d21e14698f99 None None] MFA Rules not processed for user `112c65065f6d4c5990f3952e0099cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:43.358630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9246177a-2331-43c5-bfa2-d21e14698f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.380773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:43.442276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 654/1310] 10.222.0.121 () {58 vars in 1067 bytes} [Mon Aug 1 16:54:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:43.451169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a951184-6dd6-4646-bb48-46979422fc58 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:43.452924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5a951184-6dd6-4646-bb48-46979422fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.575562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a951184-6dd6-4646-bb48-46979422fc58 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:43.659525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad78f6-db26-4c5a-a535-12b4127352d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:43.660071 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad78f6-db26-4c5a-a535-12b4127352d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:43.660356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad78f6-db26-4c5a-a535-12b4127352d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:43.660632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad78f6-db26-4c5a-a535-12b4127352d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:43.662279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-73ad78f6-db26-4c5a-a535-12b4127352d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:43.723433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:43.792544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad78f6-db26-4c5a-a535-12b4127352d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:43.794006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad78f6-db26-4c5a-a535-12b4127352d6 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:43.815564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 657/1311] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:46.150623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae318fc8-7635-4baa-bf42-2653e670508b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:46.151138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae318fc8-7635-4baa-bf42-2653e670508b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:46.151255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae318fc8-7635-4baa-bf42-2653e670508b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:46.152735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 655/1312] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:54:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:46.158132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c40c7-f801-41f5-9612-fd26edc77834 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:46.158591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c40c7-f801-41f5-9612-fd26edc77834 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:46.158778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c40c7-f801-41f5-9612-fd26edc77834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:46.242001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-be3c40c7-f801-41f5-9612-fd26edc77834 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:46.243291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be3c40c7-f801-41f5-9612-fd26edc77834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:46.390691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 658/1313] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:46.450362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae318fc8-7635-4baa-bf42-2653e670508b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:46.452024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae318fc8-7635-4baa-bf42-2653e670508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:46.570709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae318fc8-7635-4baa-bf42-2653e670508b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:46.641611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:46.644157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d21d34-aa03-4c03-88e4-68dd1b4dc58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:46.644907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d21d34-aa03-4c03-88e4-68dd1b4dc58d service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:46.645248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d21d34-aa03-4c03-88e4-68dd1b4dc58d service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:46.645546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d21d34-aa03-4c03-88e4-68dd1b4dc58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:46.648449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-48d21d34-aa03-4c03-88e4-68dd1b4dc58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:46.764378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d21d34-aa03-4c03-88e4-68dd1b4dc58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:46.765820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d21d34-aa03-4c03-88e4-68dd1b4dc58d service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:46.784961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 656/1314] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:54:49.095098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01138d-5918-4743-a3dd-1dade8dcdd33 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.095670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01138d-5918-4743-a3dd-1dade8dcdd33 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.095670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01138d-5918-4743-a3dd-1dade8dcdd33 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.097066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 659/1315] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:54:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:49.102747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7082755-f99c-4766-a0a0-1f5491a0222c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.103172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7082755-f99c-4766-a0a0-1f5491a0222c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.103392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7082755-f99c-4766-a0a0-1f5491a0222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.168463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e7082755-f99c-4766-a0a0-1f5491a0222c None None] MFA Rules not processed for user `04626cce951b4727b3091cbedb6da386`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:49.169695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e7082755-f99c-4766-a0a0-1f5491a0222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.220205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:49.265629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 657/1316] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:49.305791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01138d-5918-4743-a3dd-1dade8dcdd33 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:49.307360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2f01138d-5918-4743-a3dd-1dade8dcdd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.317176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:49.412558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01138d-5918-4743-a3dd-1dade8dcdd33 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:49.484834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c260d9-bd68-4884-a2eb-4f8c65e6ac7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:49.485449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c260d9-bd68-4884-a2eb-4f8c65e6ac7d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:49.485729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c260d9-bd68-4884-a2eb-4f8c65e6ac7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:49.486001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c260d9-bd68-4884-a2eb-4f8c65e6ac7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:49.487635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-34c260d9-bd68-4884-a2eb-4f8c65e6ac7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:49.551058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:49.600547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c260d9-bd68-4884-a2eb-4f8c65e6ac7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:49.601996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c260d9-bd68-4884-a2eb-4f8c65e6ac7d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:49.619837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 660/1317] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:52.197448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e69d-ec60-4878-b929-15ce6e4b7eb9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.198041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e69d-ec60-4878-b929-15ce6e4b7eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.198041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e69d-ec60-4878-b929-15ce6e4b7eb9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.199420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 658/1318] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:54:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:52.204534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8dc03-3f09-4dd0-bae3-05d632143588 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.204941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8dc03-3f09-4dd0-bae3-05d632143588 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.205103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8dc03-3f09-4dd0-bae3-05d632143588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.271545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c1c8dc03-3f09-4dd0-bae3-05d632143588 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:52.272808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c1c8dc03-3f09-4dd0-bae3-05d632143588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:52.368184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 661/1319] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:52.406601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77e69d-ec60-4878-b929-15ce6e4b7eb9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:52.408153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad77e69d-ec60-4878-b929-15ce6e4b7eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:52.511946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77e69d-ec60-4878-b929-15ce6e4b7eb9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:52.585420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06484690-96d3-4064-9f9f-ff905b106641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:52.586033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484690-96d3-4064-9f9f-ff905b106641 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:52.586349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484690-96d3-4064-9f9f-ff905b106641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:52.586624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484690-96d3-4064-9f9f-ff905b106641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:52.588224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-06484690-96d3-4064-9f9f-ff905b106641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:52.594954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:52.695033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06484690-96d3-4064-9f9f-ff905b106641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:52.696459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06484690-96d3-4064-9f9f-ff905b106641 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:52.714050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 659/1320] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:55.387574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad500-5510-419e-8457-2b3d941c4158 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.388154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad500-5510-419e-8457-2b3d941c4158 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.388154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad500-5510-419e-8457-2b3d941c4158 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.389510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 662/1321] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:54:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:55.394732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f224acd-6e8e-44d3-b4ec-cb74de76466e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.395122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f224acd-6e8e-44d3-b4ec-cb74de76466e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.395315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f224acd-6e8e-44d3-b4ec-cb74de76466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.461753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f224acd-6e8e-44d3-b4ec-cb74de76466e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:55.462987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f224acd-6e8e-44d3-b4ec-cb74de76466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:55.523920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.571339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 660/1322] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:55.608488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad500-5510-419e-8457-2b3d941c4158 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:55.610061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6c4ad500-5510-419e-8457-2b3d941c4158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:55.631085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.732058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad500-5510-419e-8457-2b3d941c4158 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:55.806013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8a4bd-f923-4cfd-beec-8909b09dc6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:55.806669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a4bd-f923-4cfd-beec-8909b09dc6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:55.806951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a4bd-f923-4cfd-beec-8909b09dc6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:55.807223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a4bd-f923-4cfd-beec-8909b09dc6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:55.808932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-58f8a4bd-f923-4cfd-beec-8909b09dc6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:55.880788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:55.920726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8a4bd-f923-4cfd-beec-8909b09dc6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:55.922185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8a4bd-f923-4cfd-beec-8909b09dc6b9 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:55.942231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 663/1323] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:54:57.987532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91bb4-afda-498d-8820-377bb3399dc9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:57.988100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91bb4-afda-498d-8820-377bb3399dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:57.988100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91bb4-afda-498d-8820-377bb3399dc9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:57.989435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 661/1324] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:54:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:54:57.995899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec4d8f-b97f-4ad1-8ebf-97caa23b2e6a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:57.996377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec4d8f-b97f-4ad1-8ebf-97caa23b2e6a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:57.996472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec4d8f-b97f-4ad1-8ebf-97caa23b2e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:58.063385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-68ec4d8f-b97f-4ad1-8ebf-97caa23b2e6a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:54:58.064498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-68ec4d8f-b97f-4ad1-8ebf-97caa23b2e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:58.160971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 664/1325] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:54:58.197723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b91bb4-afda-498d-8820-377bb3399dc9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:54:58.199311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f2b91bb4-afda-498d-8820-377bb3399dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:58.314136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b91bb4-afda-498d-8820-377bb3399dc9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:54:58.388406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c63cb4-2458-497f-8143-ec51927d3750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:54:58.389051 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63cb4-2458-497f-8143-ec51927d3750 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:54:58.389335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63cb4-2458-497f-8143-ec51927d3750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:54:58.389611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63cb4-2458-497f-8143-ec51927d3750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:54:58.391329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-34c63cb4-2458-497f-8143-ec51927d3750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:54:58.408541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:54:58.505598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63cb4-2458-497f-8143-ec51927d3750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:54:58.507073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63cb4-2458-497f-8143-ec51927d3750 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:54:58.525726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 662/1326] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:00.614198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428cf77-c9aa-4ace-aa0f-f8579daceba0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.614840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428cf77-c9aa-4ace-aa0f-f8579daceba0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.614840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428cf77-c9aa-4ace-aa0f-f8579daceba0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.616439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 665/1327] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:00.622014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029eebc-5ca9-4c03-a348-20baed1ab95b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.622664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029eebc-5ca9-4c03-a348-20baed1ab95b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.622664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029eebc-5ca9-4c03-a348-20baed1ab95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.695371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4029eebc-5ca9-4c03-a348-20baed1ab95b None None] MFA Rules not processed for user `04626cce951b4727b3091cbedb6da386`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:00.696622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4029eebc-5ca9-4c03-a348-20baed1ab95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:00.764166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:00.796940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 663/1328] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:00.850762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4f4ef-91c7-4757-bf62-3a2ffe2509b2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.851153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4f4ef-91c7-4757-bf62-3a2ffe2509b2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.851499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4f4ef-91c7-4757-bf62-3a2ffe2509b2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.853137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 666/1329] 10.222.0.121 () {54 vars in 970 bytes} [Mon Aug 1 16:55:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:00.859618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a7e4-1f28-429c-bbea-04be9633a7d9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:00.859906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a7e4-1f28-429c-bbea-04be9633a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:00.860186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421a7e4-1f28-429c-bbea-04be9633a7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:00.941562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8421a7e4-1f28-429c-bbea-04be9633a7d9 None None] MFA Rules not processed for user `112c65065f6d4c5990f3952e0099cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:00.942854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8421a7e4-1f28-429c-bbea-04be9633a7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:01.021668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 664/1330] 10.222.0.121 () {58 vars in 1067 bytes} [Mon Aug 1 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:01.031749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4f4ef-91c7-4757-bf62-3a2ffe2509b2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:01.033388 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-72a4f4ef-91c7-4757-bf62-3a2ffe2509b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:01.067169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:01.142271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4f4ef-91c7-4757-bf62-3a2ffe2509b2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:01.218642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c60e1-33ae-4fa0-9d56-01fe03c6a45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:01.219278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c60e1-33ae-4fa0-9d56-01fe03c6a45c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:01.219564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c60e1-33ae-4fa0-9d56-01fe03c6a45c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:01.219840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c60e1-33ae-4fa0-9d56-01fe03c6a45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:01.221500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-783c60e1-33ae-4fa0-9d56-01fe03c6a45c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:01.301720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:01.372265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c60e1-33ae-4fa0-9d56-01fe03c6a45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:01.374394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c60e1-33ae-4fa0-9d56-01fe03c6a45c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:01.400369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 667/1331] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:04.120130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d5dd-4de5-4e4c-9fb3-e8f7935c54fc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:04.120663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d5dd-4de5-4e4c-9fb3-e8f7935c54fc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:04.120753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252d5dd-4de5-4e4c-9fb3-e8f7935c54fc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:04.122058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 665/1332] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:04.127142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8228e5-23d1-41a6-858e-5fd134a0eff7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:04.127571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8228e5-23d1-41a6-858e-5fd134a0eff7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:04.127728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8228e5-23d1-41a6-858e-5fd134a0eff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:04.195170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7d8228e5-23d1-41a6-858e-5fd134a0eff7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:04.196411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7d8228e5-23d1-41a6-858e-5fd134a0eff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:04.294865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 668/1333] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:04.330839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d5dd-4de5-4e4c-9fb3-e8f7935c54fc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:04.332385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4252d5dd-4de5-4e4c-9fb3-e8f7935c54fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:04.405664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:04.441009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252d5dd-4de5-4e4c-9fb3-e8f7935c54fc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:04.518330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fc50a-a921-44d6-87f2-6dcdaabbc6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:04.518891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fc50a-a921-44d6-87f2-6dcdaabbc6ef service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:04.519186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fc50a-a921-44d6-87f2-6dcdaabbc6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:04.519437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fc50a-a921-44d6-87f2-6dcdaabbc6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:04.521222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-794fc50a-a921-44d6-87f2-6dcdaabbc6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:04.638605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fc50a-a921-44d6-87f2-6dcdaabbc6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:04.640055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fc50a-a921-44d6-87f2-6dcdaabbc6ef service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:04.650459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:04.659112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 666/1334] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:06.711286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd046c4-f349-41e8-9fd7-71e385346d01 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.711774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd046c4-f349-41e8-9fd7-71e385346d01 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.711898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd046c4-f349-41e8-9fd7-71e385346d01 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.713213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 669/1335] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:06.718587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ec2f-d37e-4309-98e1-1e0ae190693a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:06.718998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ec2f-d37e-4309-98e1-1e0ae190693a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:06.719156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ec2f-d37e-4309-98e1-1e0ae190693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:06.785705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-db78ec2f-d37e-4309-98e1-1e0ae190693a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:06.787451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-db78ec2f-d37e-4309-98e1-1e0ae190693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:06.882138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 667/1336] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:06.922250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd046c4-f349-41e8-9fd7-71e385346d01 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:06.923899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-edd046c4-f349-41e8-9fd7-71e385346d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:06.963638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:07.028411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd046c4-f349-41e8-9fd7-71e385346d01 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:07.104336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08ea96-30d7-4340-8d4a-ad7ee72264b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:07.104962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ea96-30d7-4340-8d4a-ad7ee72264b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:07.105293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ea96-30d7-4340-8d4a-ad7ee72264b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:07.105745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ea96-30d7-4340-8d4a-ad7ee72264b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:07.107249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be08ea96-30d7-4340-8d4a-ad7ee72264b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:07.189432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:07.216128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08ea96-30d7-4340-8d4a-ad7ee72264b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:07.217583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08ea96-30d7-4340-8d4a-ad7ee72264b0 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:07.236312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 670/1337] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:09.687109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6c832-7b1c-46fe-8cfe-62e8c0b4cc31 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:09.687680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6c832-7b1c-46fe-8cfe-62e8c0b4cc31 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:09.687680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6c832-7b1c-46fe-8cfe-62e8c0b4cc31 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:09.689057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 668/1338] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:09.694677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829367b-082e-429c-8a43-f72ac498e0af None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:09.695101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829367b-082e-429c-8a43-f72ac498e0af None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:09.695251 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829367b-082e-429c-8a43-f72ac498e0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:09.762431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9829367b-082e-429c-8a43-f72ac498e0af None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:09.763685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9829367b-082e-429c-8a43-f72ac498e0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:09.864438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 671/1339] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:09.901597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6c832-7b1c-46fe-8cfe-62e8c0b4cc31 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:09.903173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-def6c832-7b1c-46fe-8cfe-62e8c0b4cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:09.976665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:10.004556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6c832-7b1c-46fe-8cfe-62e8c0b4cc31 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:10.077886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ae42-ad5f-4c12-a6df-8de05e24daac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:10.078536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ae42-ad5f-4c12-a6df-8de05e24daac service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:10.078818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ae42-ad5f-4c12-a6df-8de05e24daac service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:10.079089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ae42-ad5f-4c12-a6df-8de05e24daac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:10.080702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47d5ae42-ad5f-4c12-a6df-8de05e24daac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:10.188185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5ae42-ad5f-4c12-a6df-8de05e24daac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:10.189611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5ae42-ad5f-4c12-a6df-8de05e24daac service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:10.207648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 669/1340] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:14.307508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf92a-08ba-4cff-ace1-912ed0c039ec None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.308043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf92a-08ba-4cff-ace1-912ed0c039ec None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.308043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccf92a-08ba-4cff-ace1-912ed0c039ec None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.309419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 672/1341] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:14.314824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905a838-d7bb-42b0-9aea-fb79faa70b2e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.315301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905a838-d7bb-42b0-9aea-fb79faa70b2e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.315542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905a838-d7bb-42b0-9aea-fb79faa70b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.321793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:14.384990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5905a838-d7bb-42b0-9aea-fb79faa70b2e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:14.386134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5905a838-d7bb-42b0-9aea-fb79faa70b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:14.487975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 670/1342] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:14.527957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf92a-08ba-4cff-ace1-912ed0c039ec None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:14.529637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-beccf92a-08ba-4cff-ace1-912ed0c039ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:14.578451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:14.635123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccf92a-08ba-4cff-ace1-912ed0c039ec None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:14.708900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740b876-f9f8-4e21-b370-4939e2fd8e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:14.709521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b876-f9f8-4e21-b370-4939e2fd8e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:14.709804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b876-f9f8-4e21-b370-4939e2fd8e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:14.710078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b876-f9f8-4e21-b370-4939e2fd8e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:14.711750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4740b876-f9f8-4e21-b370-4939e2fd8e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:14.809237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:14.825827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b876-f9f8-4e21-b370-4939e2fd8e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:14.827288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740b876-f9f8-4e21-b370-4939e2fd8e70 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:14.845591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 673/1343] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:17.550723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b4e7-3b10-43cd-975d-2cba5c070309 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:17.551295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b4e7-3b10-43cd-975d-2cba5c070309 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:17.551295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b4e7-3b10-43cd-975d-2cba5c070309 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:17.553172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 671/1344] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:17.558458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ff3e8-d744-46aa-a9ec-bf24228acf64 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:17.558899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ff3e8-d744-46aa-a9ec-bf24228acf64 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:17.559033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ff3e8-d744-46aa-a9ec-bf24228acf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:17.625818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2a8ff3e8-d744-46aa-a9ec-bf24228acf64 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:17.627082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2a8ff3e8-d744-46aa-a9ec-bf24228acf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:17.735404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 674/1345] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:17.773178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b4e7-3b10-43cd-975d-2cba5c070309 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:17.774846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a84b4e7-3b10-43cd-975d-2cba5c070309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:17.865248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:17.883355 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b4e7-3b10-43cd-975d-2cba5c070309 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:17.960825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce71a0-7f9e-4d56-bca7-c6a08eea5566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:17.961467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce71a0-7f9e-4d56-bca7-c6a08eea5566 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:17.961748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce71a0-7f9e-4d56-bca7-c6a08eea5566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:17.962017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce71a0-7f9e-4d56-bca7-c6a08eea5566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:17.963755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04ce71a0-7f9e-4d56-bca7-c6a08eea5566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:18.077420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce71a0-7f9e-4d56-bca7-c6a08eea5566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:18.078820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce71a0-7f9e-4d56-bca7-c6a08eea5566 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:18.097453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 672/1346] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:22.357449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3e87-9809-4c41-984e-661f696b61ea None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:22.358029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3e87-9809-4c41-984e-661f696b61ea None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:22.358029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3e87-9809-4c41-984e-661f696b61ea None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:22.359403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 675/1347] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:22.367223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dd232-1589-4ffb-80de-44a64e0e6d6f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:22.367921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dd232-1589-4ffb-80de-44a64e0e6d6f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:22.367921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dd232-1589-4ffb-80de-44a64e0e6d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:22.385409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:22.442424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0f1dd232-1589-4ffb-80de-44a64e0e6d6f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:22.443687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f1dd232-1589-4ffb-80de-44a64e0e6d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:22.548287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 673/1348] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:22.588457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3e87-9809-4c41-984e-661f696b61ea None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:22.590010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-369d3e87-9809-4c41-984e-661f696b61ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:22.653448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:22.705704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d3e87-9809-4c41-984e-661f696b61ea None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:22.800821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd00d8-fca0-41c3-a536-aa0f2369d64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:22.801464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd00d8-fca0-41c3-a536-aa0f2369d64a service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:22.802325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd00d8-fca0-41c3-a536-aa0f2369d64a service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:22.802611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd00d8-fca0-41c3-a536-aa0f2369d64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:22.804274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-80bd00d8-fca0-41c3-a536-aa0f2369d64a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:22.930993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:22.935586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd00d8-fca0-41c3-a536-aa0f2369d64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:22.937322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd00d8-fca0-41c3-a536-aa0f2369d64a service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:22.960314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 676/1349] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:27.946360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f42e3-2c1f-418a-9e1c-1e4eba07a900 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:27.946857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f42e3-2c1f-418a-9e1c-1e4eba07a900 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:27.946965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f42e3-2c1f-418a-9e1c-1e4eba07a900 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:27.948575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 674/1350] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 16:55:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:27.956819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac0a1b-aead-4ba0-8cd8-941a60c18ab6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:27.957666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac0a1b-aead-4ba0-8cd8-941a60c18ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:27.958314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac0a1b-aead-4ba0-8cd8-941a60c18ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:28.098840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-19ac0a1b-aead-4ba0-8cd8-941a60c18ab6 None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:28.098840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-19ac0a1b-aead-4ba0-8cd8-941a60c18ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:28.216263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 677/1351] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 16:55:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:32.276983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a788b-8f13-451a-ab59-3c38c24c341b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:32.277571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a788b-8f13-451a-ab59-3c38c24c341b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:32.277571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a788b-8f13-451a-ab59-3c38c24c341b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:32.279054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 675/1352] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 16:55:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:32.284323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172afcc-aa8c-40c3-9c4e-66b8ebd13445 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:32.284790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172afcc-aa8c-40c3-9c4e-66b8ebd13445 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:32.285075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172afcc-aa8c-40c3-9c4e-66b8ebd13445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:32.343801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:32.370682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5172afcc-aa8c-40c3-9c4e-66b8ebd13445 None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:32.371947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5172afcc-aa8c-40c3-9c4e-66b8ebd13445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:32.487110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 678/1353] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 16:55:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:32.546537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=59 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:33.988132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c63cd-c046-48c1-84b0-b0bd72be5760 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:33.988779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c63cd-c046-48c1-84b0-b0bd72be5760 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:33.988779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c63cd-c046-48c1-84b0-b0bd72be5760 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:33.990057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 676/1354] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 16:55:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:33.995076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bbe80-31db-4e25-b9f7-44a51dc2ee9f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:33.995763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bbe80-31db-4e25-b9f7-44a51dc2ee9f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:33.995763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bbe80-31db-4e25-b9f7-44a51dc2ee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:34.083130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1c0bbe80-31db-4e25-b9f7-44a51dc2ee9f None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:34.084381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1c0bbe80-31db-4e25-b9f7-44a51dc2ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:34.125620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:34.191892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 679/1355] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 16:55:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:37.628453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fd9b-d5ee-4b2b-8802-e1df92bf4e4b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:37.629395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fd9b-d5ee-4b2b-8802-e1df92bf4e4b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:37.629828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fd9b-d5ee-4b2b-8802-e1df92bf4e4b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:37.631395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 677/1356] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:37.637821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460081f-e30a-4c80-a030-a186390be891 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:37.638327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460081f-e30a-4c80-a030-a186390be891 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:37.639143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460081f-e30a-4c80-a030-a186390be891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:37.719378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9460081f-e30a-4c80-a030-a186390be891 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:37.720915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9460081f-e30a-4c80-a030-a186390be891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:37.828094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 680/1357] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:37.887998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccbf2b-4a22-4081-93b9-acf9ff7a2edc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:37.888609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccbf2b-4a22-4081-93b9-acf9ff7a2edc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:37.889115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccbf2b-4a22-4081-93b9-acf9ff7a2edc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:37.890801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 678/1358] 10.222.0.121 () {54 vars in 967 bytes} [Mon Aug 1 16:55:37 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:55:37.903753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a777-8dbf-437b-8006-42d510a54136 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:37.904420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a777-8dbf-437b-8006-42d510a54136 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:37.904962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a777-8dbf-437b-8006-42d510a54136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:37.926390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:37.996722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-15f8a777-8dbf-437b-8006-42d510a54136 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:37.997936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-15f8a777-8dbf-437b-8006-42d510a54136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:38.141459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 681/1359] 10.222.0.121 () {58 vars in 1064 bytes} [Mon Aug 1 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:38.150192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccbf2b-4a22-4081-93b9-acf9ff7a2edc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:38.151789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b8ccbf2b-4a22-4081-93b9-acf9ff7a2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:38.304507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccbf2b-4a22-4081-93b9-acf9ff7a2edc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:38.384040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:38.427343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927413e-07b3-4233-9ed7-edd5cde56111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:38.428345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927413e-07b3-4233-9ed7-edd5cde56111 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:38.428730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927413e-07b3-4233-9ed7-edd5cde56111 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:38.429109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927413e-07b3-4233-9ed7-edd5cde56111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:38.430992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3927413e-07b3-4233-9ed7-edd5cde56111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:38.532449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927413e-07b3-4233-9ed7-edd5cde56111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:38.534199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927413e-07b3-4233-9ed7-edd5cde56111 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:38.553807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 679/1360] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:40.804772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb29d3-db7a-4509-9c9c-35d25759483f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:40.805294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb29d3-db7a-4509-9c9c-35d25759483f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:40.805294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb29d3-db7a-4509-9c9c-35d25759483f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:40.806873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 682/1361] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:40.811883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908d62-1817-4cf2-9d44-f4a3db99da01 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:40.812333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908d62-1817-4cf2-9d44-f4a3db99da01 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:40.812442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908d62-1817-4cf2-9d44-f4a3db99da01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:40.885539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-25908d62-1817-4cf2-9d44-f4a3db99da01 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:40.886924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-25908d62-1817-4cf2-9d44-f4a3db99da01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:40.928031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:41.001506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 680/1362] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:41.051433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb29d3-db7a-4509-9c9c-35d25759483f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:41.053137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7fcb29d3-db7a-4509-9c9c-35d25759483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:41.143274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:41.270054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb29d3-db7a-4509-9c9c-35d25759483f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:41.418239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ab70-e234-4341-b524-e586198421aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:41.418911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ab70-e234-4341-b524-e586198421aa service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:41.419197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ab70-e234-4341-b524-e586198421aa service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:41.419618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ab70-e234-4341-b524-e586198421aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:41.421730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5ac0ab70-e234-4341-b524-e586198421aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:41.452745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:41.542615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ab70-e234-4341-b524-e586198421aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:41.544323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ab70-e234-4341-b524-e586198421aa service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:41.567318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 683/1363] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:43.981920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc33ab-74cd-4487-b61b-70598e84ac26 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:43.982496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc33ab-74cd-4487-b61b-70598e84ac26 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:43.982496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc33ab-74cd-4487-b61b-70598e84ac26 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:43.984378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 681/1364] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:43.991090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8f43b-46d4-4d0d-a570-83bdeacdb536 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:43.991604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8f43b-46d4-4d0d-a570-83bdeacdb536 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:43.991724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8f43b-46d4-4d0d-a570-83bdeacdb536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:44.072545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-36d8f43b-46d4-4d0d-a570-83bdeacdb536 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:44.074013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-36d8f43b-46d4-4d0d-a570-83bdeacdb536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:44.194041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:44.198354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 684/1365] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:44.245304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e25dd-7bec-47c5-a777-fb532622ce10 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:44.245590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e25dd-7bec-47c5-a777-fb532622ce10 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:44.245872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e25dd-7bec-47c5-a777-fb532622ce10 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:44.247572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 682/1366] 10.222.0.121 () {54 vars in 967 bytes} [Mon Aug 1 16:55:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:44.253865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8746c3-8130-4f58-b90f-fb15f5ca6430 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:44.254355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8746c3-8130-4f58-b90f-fb15f5ca6430 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:44.254646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8746c3-8130-4f58-b90f-fb15f5ca6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:44.347003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fb8746c3-8130-4f58-b90f-fb15f5ca6430 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:44.349171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fb8746c3-8130-4f58-b90f-fb15f5ca6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:44.518389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 685/1367] 10.222.0.121 () {58 vars in 1064 bytes} [Mon Aug 1 16:55:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:44.527692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e25dd-7bec-47c5-a777-fb532622ce10 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:44.529235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2f0e25dd-7bec-47c5-a777-fb532622ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:44.693608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e25dd-7bec-47c5-a777-fb532622ce10 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:44.718026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:44.841526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70d970-0071-451f-ba5d-92dc195935c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:44.842166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d970-0071-451f-ba5d-92dc195935c1 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:44.842477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d970-0071-451f-ba5d-92dc195935c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:44.842758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d970-0071-451f-ba5d-92dc195935c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:44.844509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6b70d970-0071-451f-ba5d-92dc195935c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:44.960145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70d970-0071-451f-ba5d-92dc195935c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:44.961841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70d970-0071-451f-ba5d-92dc195935c1 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:44.989708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 683/1368] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:45.842093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa264-e382-4c4a-8c1a-fcbde4460759 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:45.842712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa264-e382-4c4a-8c1a-fcbde4460759 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:45.843114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa264-e382-4c4a-8c1a-fcbde4460759 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:45.844665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 686/1369] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:45.850830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9387e-037a-4111-af45-7d00af0cbec8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:45.851123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9387e-037a-4111-af45-7d00af0cbec8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:45.851403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9387e-037a-4111-af45-7d00af0cbec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:45.890318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:45.931879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-91e9387e-037a-4111-af45-7d00af0cbec8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:45.933122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-91e9387e-037a-4111-af45-7d00af0cbec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:46.053804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 684/1370] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:46.416642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f60aa-cd0c-40b9-bf89-4e9a2cc9852e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:46.416642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f60aa-cd0c-40b9-bf89-4e9a2cc9852e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:46.416642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f60aa-cd0c-40b9-bf89-4e9a2cc9852e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:46.419248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 687/1371] 10.222.0.121 () {54 vars in 969 bytes} [Mon Aug 1 16:55:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:46.423246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb719-db39-41cf-ad29-0898ba8ecbb1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:46.423542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb719-db39-41cf-ad29-0898ba8ecbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:46.423845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb719-db39-41cf-ad29-0898ba8ecbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:46.513357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b9ceb719-db39-41cf-ad29-0898ba8ecbb1 None None] MFA Rules not processed for user `3e9b1bcc6f8e4bbdacf66021bfe57bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:46.514631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9ceb719-db39-41cf-ad29-0898ba8ecbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:46.563978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:46.596959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 685/1372] 10.222.0.121 () {58 vars in 1066 bytes} [Mon Aug 1 16:55:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:46.606186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f60aa-cd0c-40b9-bf89-4e9a2cc9852e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:46.607766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-694f60aa-cd0c-40b9-bf89-4e9a2cc9852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:46.667293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:46.730464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f60aa-cd0c-40b9-bf89-4e9a2cc9852e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:46.813672 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eeb57c-8244-4970-88bb-bd5b6901f057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:46.814344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eeb57c-8244-4970-88bb-bd5b6901f057 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:46.814633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eeb57c-8244-4970-88bb-bd5b6901f057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:46.814918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eeb57c-8244-4970-88bb-bd5b6901f057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:46.816574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a6eeb57c-8244-4970-88bb-bd5b6901f057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:46.943613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:46.962146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eeb57c-8244-4970-88bb-bd5b6901f057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:46.964693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eeb57c-8244-4970-88bb-bd5b6901f057 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:46.990054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 688/1373] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:47.276251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876cd6-e50e-4e32-ae5b-bed42cd9ee4d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:47.276707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876cd6-e50e-4e32-ae5b-bed42cd9ee4d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:47.277019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876cd6-e50e-4e32-ae5b-bed42cd9ee4d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:47.283164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 686/1374] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:47.284474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221bed-e29b-4916-aa0a-13b50980e7d0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:47.284576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221bed-e29b-4916-aa0a-13b50980e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:47.284835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221bed-e29b-4916-aa0a-13b50980e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:47.385802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a8221bed-e29b-4916-aa0a-13b50980e7d0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:47.387100 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a8221bed-e29b-4916-aa0a-13b50980e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:47.497759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 689/1375] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:47.545768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa876cd6-e50e-4e32-ae5b-bed42cd9ee4d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:47.547477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aa876cd6-e50e-4e32-ae5b-bed42cd9ee4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:47.698948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa876cd6-e50e-4e32-ae5b-bed42cd9ee4d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:47.753462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:47.816872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36162c12-65e1-4c16-ad00-66828daf89f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:47.817506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36162c12-65e1-4c16-ad00-66828daf89f0 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:47.817792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36162c12-65e1-4c16-ad00-66828daf89f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:47.818071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36162c12-65e1-4c16-ad00-66828daf89f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:47.820345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36162c12-65e1-4c16-ad00-66828daf89f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:47.926460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36162c12-65e1-4c16-ad00-66828daf89f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:47.928867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36162c12-65e1-4c16-ad00-66828daf89f0 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:47.948472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 687/1376] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:50.038347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62595-2f4b-4410-9141-cce0fbe8b30c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:50.038903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62595-2f4b-4410-9141-cce0fbe8b30c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:50.039358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62595-2f4b-4410-9141-cce0fbe8b30c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:50.041238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 690/1377] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:50.046749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1163-5a36-4fc6-aa13-2233f6ea1bd1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:50.047203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1163-5a36-4fc6-aa13-2233f6ea1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:50.047429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1163-5a36-4fc6-aa13-2233f6ea1bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:50.128484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aa2d1163-5a36-4fc6-aa13-2233f6ea1bd1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:50.129617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aa2d1163-5a36-4fc6-aa13-2233f6ea1bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:50.137111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:50.229014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 688/1378] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:50.272937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc62595-2f4b-4410-9141-cce0fbe8b30c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:50.274507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5fc62595-2f4b-4410-9141-cce0fbe8b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:50.338390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:50.443020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc62595-2f4b-4410-9141-cce0fbe8b30c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:50.605071 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a570df-faf1-485f-85b3-a0726b079837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:50.605624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a570df-faf1-485f-85b3-a0726b079837 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:50.605921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a570df-faf1-485f-85b3-a0726b079837 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:50.606201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a570df-faf1-485f-85b3-a0726b079837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:50.607952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c7a570df-faf1-485f-85b3-a0726b079837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:50.632868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:50.716906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a570df-faf1-485f-85b3-a0726b079837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:50.718986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a570df-faf1-485f-85b3-a0726b079837 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:50.740849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 691/1379] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:52.879905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f7db-f541-4b88-a95d-a371219453cc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:52.879905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f7db-f541-4b88-a95d-a371219453cc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:52.879905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f7db-f541-4b88-a95d-a371219453cc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:52.886143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 689/1380] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:52 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:52.888295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910286-9fff-4f80-a26e-e66454455fa5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:52.888801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910286-9fff-4f80-a26e-e66454455fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:52.888967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13910286-9fff-4f80-a26e-e66454455fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:52.980885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-13910286-9fff-4f80-a26e-e66454455fa5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:52.982573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13910286-9fff-4f80-a26e-e66454455fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:53.129610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:53.138510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 692/1381] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:53.184601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f7db-f541-4b88-a95d-a371219453cc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:53.186207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ed76f7db-f541-4b88-a95d-a371219453cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:53.348926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:53.362360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f7db-f541-4b88-a95d-a371219453cc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:53.499870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9e72f-d490-409d-9d2a-7ad6ce5ac3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:53.500560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e72f-d490-409d-9d2a-7ad6ce5ac3d1 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:53.500861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e72f-d490-409d-9d2a-7ad6ce5ac3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:53.501127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9e72f-d490-409d-9d2a-7ad6ce5ac3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:53.503046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fab9e72f-d490-409d-9d2a-7ad6ce5ac3d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:53.620407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9e72f-d490-409d-9d2a-7ad6ce5ac3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:53.622445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9e72f-d490-409d-9d2a-7ad6ce5ac3d1 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:53.635299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:53.645213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 690/1382] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:55.744655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41d47-6158-43b4-ad42-2bce2723cd51 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:55.746017 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41d47-6158-43b4-ad42-2bce2723cd51 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:55.746017 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca41d47-6158-43b4-ad42-2bce2723cd51 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:55.747725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 693/1383] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:55 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:55.755324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850db68-e363-4622-bd7b-42eff73e3398 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:55.755995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850db68-e363-4622-bd7b-42eff73e3398 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:55.755995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850db68-e363-4622-bd7b-42eff73e3398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:55.829824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c850db68-e363-4622-bd7b-42eff73e3398 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:55.831611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c850db68-e363-4622-bd7b-42eff73e3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:55.953848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 691/1384] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:55:56.001200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca41d47-6158-43b4-ad42-2bce2723cd51 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:56.003033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5ca41d47-6158-43b4-ad42-2bce2723cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:56.173765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca41d47-6158-43b4-ad42-2bce2723cd51 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:56.252759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:56.315471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1244820-4771-4a18-8a00-c3bef2d8252d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:56.316345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1244820-4771-4a18-8a00-c3bef2d8252d service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:56.316721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1244820-4771-4a18-8a00-c3bef2d8252d service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:56.317168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1244820-4771-4a18-8a00-c3bef2d8252d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:56.320020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b1244820-4771-4a18-8a00-c3bef2d8252d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:56.430197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1244820-4771-4a18-8a00-c3bef2d8252d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:56.431962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1244820-4771-4a18-8a00-c3bef2d8252d service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:56.451237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 694/1385] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:55:58.821928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ec37-da0f-47a4-9876-6f0c99b46599 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:58.822528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ec37-da0f-47a4-9876-6f0c99b46599 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:58.822528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17ec37-da0f-47a4-9876-6f0c99b46599 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:58.823988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 692/1386] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:55:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:55:58.830116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37405-d0b1-4ffb-9c4e-140ac134c26c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:58.830758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37405-d0b1-4ffb-9c4e-140ac134c26c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:58.830758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37405-d0b1-4ffb-9c4e-140ac134c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:58.909404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3df37405-d0b1-4ffb-9c4e-140ac134c26c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:55:58.910755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3df37405-d0b1-4ffb-9c4e-140ac134c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:58.955557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:59.047605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 695/1387] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:55:59.094318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ec37-da0f-47a4-9876-6f0c99b46599 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:55:59.095858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1b17ec37-da0f-47a4-9876-6f0c99b46599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:59.183391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:59.261950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17ec37-da0f-47a4-9876-6f0c99b46599 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:55:59.393191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f20ee0-784d-4970-bc0e-7af9c7bf3b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:55:59.393749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f20ee0-784d-4970-bc0e-7af9c7bf3b4a service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:55:59.394048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f20ee0-784d-4970-bc0e-7af9c7bf3b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:55:59.394347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f20ee0-784d-4970-bc0e-7af9c7bf3b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:55:59.396785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c8f20ee0-784d-4970-bc0e-7af9c7bf3b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:55:59.449608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:55:59.511108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f20ee0-784d-4970-bc0e-7af9c7bf3b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:55:59.512722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f20ee0-784d-4970-bc0e-7af9c7bf3b4a service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:55:59.532392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 693/1388] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:01.792610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ab7f-e7c3-4fdf-8887-5e7b2c97e80e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:01.793311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ab7f-e7c3-4fdf-8887-5e7b2c97e80e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:01.793311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626ab7f-e7c3-4fdf-8887-5e7b2c97e80e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:01.794831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 696/1389] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:56:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:01.800473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19967-434e-4967-9532-e7a1aa77a266 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:01.800970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19967-434e-4967-9532-e7a1aa77a266 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:01.801078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e19967-434e-4967-9532-e7a1aa77a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:01.870990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e2e19967-434e-4967-9532-e7a1aa77a266 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:01.872212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e2e19967-434e-4967-9532-e7a1aa77a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:01.972526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 694/1390] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:02.017355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ab7f-e7c3-4fdf-8887-5e7b2c97e80e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:02.018907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4626ab7f-e7c3-4fdf-8887-5e7b2c97e80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:02.183000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626ab7f-e7c3-4fdf-8887-5e7b2c97e80e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:02.199853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:02.297133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a890-8048-4a25-9a93-ae61ac6cc330 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:02.297417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a890-8048-4a25-9a93-ae61ac6cc330 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:02.297691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a890-8048-4a25-9a93-ae61ac6cc330 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:02.299294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 695/1391] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:56:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:02.301991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61ce3-ab53-4e12-a24e-3f3db3842805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:02.302588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61ce3-ab53-4e12-a24e-3f3db3842805 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:02.302924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61ce3-ab53-4e12-a24e-3f3db3842805 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:02.303151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61ce3-ab53-4e12-a24e-3f3db3842805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:02.305202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4181-f0a0-457a-a109-3a0af492a9c3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:02.305489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4181-f0a0-457a-a109-3a0af492a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:02.305602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eec61ce3-ab53-4e12-a24e-3f3db3842805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:02.305763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4181-f0a0-457a-a109-3a0af492a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:02.328946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:02.384461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-07ab4181-f0a0-457a-a109-3a0af492a9c3 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:02.385960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-07ab4181-f0a0-457a-a109-3a0af492a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:02.418333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61ce3-ab53-4e12-a24e-3f3db3842805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:02.420267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec61ce3-ab53-4e12-a24e-3f3db3842805 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:02.441269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 697/1392] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:02.487560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 696/1393] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:02.551807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7632b55-2d57-4f9c-8627-742bfbb09062 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:02.552096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7632b55-2d57-4f9c-8627-742bfbb09062 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:02.552374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7632b55-2d57-4f9c-8627-742bfbb09062 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:02.554363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 698/1394] 10.222.0.121 () {54 vars in 971 bytes} [Mon Aug 1 16:56:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:02.560010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6d19-8cf0-4bfd-93f9-fd5f97d7547b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:02.560416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6d19-8cf0-4bfd-93f9-fd5f97d7547b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:02.560758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad6d19-8cf0-4bfd-93f9-fd5f97d7547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:02.645753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d9ad6d19-8cf0-4bfd-93f9-fd5f97d7547b None None] MFA Rules not processed for user `bf25e3be640643c1a11fc21e08efdc70`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:02.647065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d9ad6d19-8cf0-4bfd-93f9-fd5f97d7547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:02.685063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:02.740186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 697/1395] 10.222.0.121 () {58 vars in 1068 bytes} [Mon Aug 1 16:56:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:02.748725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7632b55-2d57-4f9c-8627-742bfbb09062 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:02.750641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a7632b55-2d57-4f9c-8627-742bfbb09062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:02.777201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:02.870921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7632b55-2d57-4f9c-8627-742bfbb09062 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:02.951657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4913e-bf27-4142-ab14-640c7c206b8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:02.952285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4913e-bf27-4142-ab14-640c7c206b8e service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:02.952569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4913e-bf27-4142-ab14-640c7c206b8e service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:02.952850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4913e-bf27-4142-ab14-640c7c206b8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:02.955360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-08c4913e-bf27-4142-ab14-640c7c206b8e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:03.042711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:03.080441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4913e-bf27-4142-ab14-640c7c206b8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:03.081891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4913e-bf27-4142-ab14-640c7c206b8e service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:03.101334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 699/1396] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:03.883748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147535-8747-4155-bb6b-ccee85d9dde0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:03.884256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147535-8747-4155-bb6b-ccee85d9dde0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:03.884363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86147535-8747-4155-bb6b-ccee85d9dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:03.956123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-86147535-8747-4155-bb6b-ccee85d9dde0 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:03.957342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-86147535-8747-4155-bb6b-ccee85d9dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:04.051317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 698/1397] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 16:56:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:04.100192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7275c-a374-447d-8bec-97240e28b3b7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:04.100697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7275c-a374-447d-8bec-97240e28b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:04.100866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7275c-a374-447d-8bec-97240e28b3b7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:04.102361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 700/1398] 10.222.0.121 () {54 vars in 948 bytes} [Mon Aug 1 16:56:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:04.109614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00fda1-fb40-45ff-9088-0179c2e02072 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:04.109614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00fda1-fb40-45ff-9088-0179c2e02072 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:04.109953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00fda1-fb40-45ff-9088-0179c2e02072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:04.174914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:04.213585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bb00fda1-fb40-45ff-9088-0179c2e02072 None None] MFA Rules not processed for user `fc5b0b0e563f46c693361b1f9bfc66d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:04.215029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bb00fda1-fb40-45ff-9088-0179c2e02072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:04.339034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 699/1399] 10.222.0.121 () {58 vars in 1045 bytes} [Mon Aug 1 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:04.352262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7275c-a374-447d-8bec-97240e28b3b7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:04.353814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8bc7275c-a374-447d-8bec-97240e28b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:04.525294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7275c-a374-447d-8bec-97240e28b3b7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:04.558699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee28f-e6b0-4550-aee0-8dcf085591cd None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:04.559190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee28f-e6b0-4550-aee0-8dcf085591cd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:04.559190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee28f-e6b0-4550-aee0-8dcf085591cd None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:04.560589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 700/1400] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:56:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:56:04.566052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3c3d-0fb4-4388-a857-049ca9c62e77 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:04.566448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3c3d-0fb4-4388-a857-049ca9c62e77 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:04.566789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3c3d-0fb4-4388-a857-049ca9c62e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:04.573540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:04.644661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b3fc3c3d-0fb4-4388-a857-049ca9c62e77 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:04.644908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:04.645368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:04.645621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:04.645796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3fc3c3d-0fb4-4388-a857-049ca9c62e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:04.645914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:04.648284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:04.717705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:04.748103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:04.749747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:04.759212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 701/1401] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 16:56:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 16:56:04.770357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 701/1402] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:56:04.818944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:04.820721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:04.911433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:04.943232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba244cc3-a797-4b4d-86b4-a6381a3608dd service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:05.096646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a905709-bdeb-44f7-9cfc-b9ac696a5fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:05.097288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905709-bdeb-44f7-9cfc-b9ac696a5fe9 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:05.097598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905709-bdeb-44f7-9cfc-b9ac696a5fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:05.097883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a905709-bdeb-44f7-9cfc-b9ac696a5fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:05.099711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9a905709-bdeb-44f7-9cfc-b9ac696a5fe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:05.215511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a905709-bdeb-44f7-9cfc-b9ac696a5fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:05.218536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a905709-bdeb-44f7-9cfc-b9ac696a5fe9 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:05.224542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:05.252529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 702/1403] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:07.356647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e775d-cfe2-4fad-bf11-554ea65b85cd None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:07.357263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e775d-cfe2-4fad-bf11-554ea65b85cd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:07.357263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e775d-cfe2-4fad-bf11-554ea65b85cd None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:07.362587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 702/1404] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:56:07 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:56:07.364242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89792d6e-adf1-441b-9aa0-a23d40c49706 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:07.364726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89792d6e-adf1-441b-9aa0-a23d40c49706 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:07.364939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89792d6e-adf1-441b-9aa0-a23d40c49706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:07.441125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-89792d6e-adf1-441b-9aa0-a23d40c49706 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:07.442490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-89792d6e-adf1-441b-9aa0-a23d40c49706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:07.548713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 703/1405] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:56:07.596633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e775d-cfe2-4fad-bf11-554ea65b85cd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:07.598186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1f3e775d-cfe2-4fad-bf11-554ea65b85cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:07.769322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e775d-cfe2-4fad-bf11-554ea65b85cd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:07.816160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:07.933883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db541d5-089a-483b-9765-60f31261c6d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:07.935670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db541d5-089a-483b-9765-60f31261c6d3 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:07.936256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db541d5-089a-483b-9765-60f31261c6d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:07.936732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db541d5-089a-483b-9765-60f31261c6d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:07.939032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9db541d5-089a-483b-9765-60f31261c6d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:08.080229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db541d5-089a-483b-9765-60f31261c6d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:08.082027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db541d5-089a-483b-9765-60f31261c6d3 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:08.105064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 703/1406] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:10.218350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4443627-9a7a-4575-a9d4-ef985f611a30 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.218350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4443627-9a7a-4575-a9d4-ef985f611a30 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.218350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4443627-9a7a-4575-a9d4-ef985f611a30 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.222778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 704/1407] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:56:10 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:10.224390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023769d-69b4-4060-b447-5d1c49280d49 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.224864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023769d-69b4-4060-b447-5d1c49280d49 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.224963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023769d-69b4-4060-b447-5d1c49280d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.296108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:10.305258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5023769d-69b4-4060-b447-5d1c49280d49 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:10.306488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5023769d-69b4-4060-b447-5d1c49280d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:10.419931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 704/1408] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:10.473422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4443627-9a7a-4575-a9d4-ef985f611a30 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:10.476078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f4443627-9a7a-4575-a9d4-ef985f611a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:10.566407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:10.650987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4443627-9a7a-4575-a9d4-ef985f611a30 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:10.830205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56799-0e71-4259-8d79-54d0cb2bbd81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:10.831406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56799-0e71-4259-8d79-54d0cb2bbd81 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:10.831406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56799-0e71-4259-8d79-54d0cb2bbd81 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:10.831406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56799-0e71-4259-8d79-54d0cb2bbd81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:10.838541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1db56799-0e71-4259-8d79-54d0cb2bbd81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:10.902904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:10.977553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56799-0e71-4259-8d79-54d0cb2bbd81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:10.979210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56799-0e71-4259-8d79-54d0cb2bbd81 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:11.001089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 705/1409] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:20.418110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=44 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:20.998587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=31 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:27.166669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be9a5-d816-4598-b9a8-a0021f4242e0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:27.167188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be9a5-d816-4598-b9a8-a0021f4242e0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:27.167188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be9a5-d816-4598-b9a8-a0021f4242e0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:27.168532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 705/1410] 10.222.0.121 () {54 vars in 923 bytes} [Mon Aug 1 16:56:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:27.173953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108a59b-b7b1-4c16-b5d6-e47d3c72faae None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:27.174425 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108a59b-b7b1-4c16-b5d6-e47d3c72faae None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:27.174574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108a59b-b7b1-4c16-b5d6-e47d3c72faae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:27.259506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4108a59b-b7b1-4c16-b5d6-e47d3c72faae None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:27.260756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4108a59b-b7b1-4c16-b5d6-e47d3c72faae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:27.417603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 706/1411] 10.222.0.121 () {58 vars in 1020 bytes} [Mon Aug 1 16:56:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:27.433149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32939-afc5-4def-b749-d5ac14372dad None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:27.433559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32939-afc5-4def-b749-d5ac14372dad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:27.433907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a32939-afc5-4def-b749-d5ac14372dad None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:27.436397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 706/1412] 10.222.0.121 () {54 vars in 923 bytes} [Mon Aug 1 16:56:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:27.441325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c4423-40d3-4a25-8fc9-1e6a1713220f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:27.441615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c4423-40d3-4a25-8fc9-1e6a1713220f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:27.441900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c4423-40d3-4a25-8fc9-1e6a1713220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:27.518618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:27.523569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8e3c4423-40d3-4a25-8fc9-1e6a1713220f None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:27.525548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8e3c4423-40d3-4a25-8fc9-1e6a1713220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:27.662403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 707/1413] 10.222.0.121 () {58 vars in 1020 bytes} [Mon Aug 1 16:56:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:30.235922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b434f-4867-4231-90ea-5cf675495e87 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:30.236498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b434f-4867-4231-90ea-5cf675495e87 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:30.236498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b434f-4867-4231-90ea-5cf675495e87 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:30.237836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:56:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 16:56:30.243772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e16c4-5c99-4310-b89d-187b99c1c568 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:30.244256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e16c4-5c99-4310-b89d-187b99c1c568 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:30.244353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e16c4-5c99-4310-b89d-187b99c1c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:30.313272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-429e16c4-5c99-4310-b89d-187b99c1c568 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:30.314559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-429e16c4-5c99-4310-b89d-187b99c1c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:30.369468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:30.412551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:30.457200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b434f-4867-4231-90ea-5cf675495e87 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:30.459098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-892b434f-4867-4231-90ea-5cf675495e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:30.612804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b434f-4867-4231-90ea-5cf675495e87 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:30.690276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:30.730726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c52de2-2a0a-4a0b-9bd5-a24e7960d25e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:30.731466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c52de2-2a0a-4a0b-9bd5-a24e7960d25e service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:30.732063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c52de2-2a0a-4a0b-9bd5-a24e7960d25e service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:30.732184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c52de2-2a0a-4a0b-9bd5-a24e7960d25e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:30.733985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-65c52de2-2a0a-4a0b-9bd5-a24e7960d25e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:30.822986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c52de2-2a0a-4a0b-9bd5-a24e7960d25e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:30.824603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c52de2-2a0a-4a0b-9bd5-a24e7960d25e service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:30.843044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 708/1416] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:31.760038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6dbc4-1148-4b86-8845-20fc0f78218e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.760615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6dbc4-1148-4b86-8845-20fc0f78218e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.760615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6dbc4-1148-4b86-8845-20fc0f78218e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.761975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:31.767431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfceb2-88f0-445f-bb20-25b4b201bc9d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:31.767889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfceb2-88f0-445f-bb20-25b4b201bc9d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:31.767980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfceb2-88f0-445f-bb20-25b4b201bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:31.850673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4cdfceb2-88f0-445f-bb20-25b4b201bc9d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:31.851946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4cdfceb2-88f0-445f-bb20-25b4b201bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:31.879705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:31.965763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:32.127044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6dbc4-1148-4b86-8845-20fc0f78218e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:32.129245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13e6dbc4-1148-4b86-8845-20fc0f78218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:32.301199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6dbc4-1148-4b86-8845-20fc0f78218e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:32.347188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:32.432882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e67f4c-28d0-4f24-a5a2-7938d21625c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:32.433553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e67f4c-28d0-4f24-a5a2-7938d21625c9 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:32.433882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e67f4c-28d0-4f24-a5a2-7938d21625c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:32.434229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e67f4c-28d0-4f24-a5a2-7938d21625c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:32.436165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-09e67f4c-28d0-4f24-a5a2-7938d21625c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:32.695284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e67f4c-28d0-4f24-a5a2-7938d21625c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:32.697610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e67f4c-28d0-4f24-a5a2-7938d21625c9 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:32.717848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 710/1419] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:56:33.645695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124f80-b37b-4594-bf66-0e3e6cfb2bf3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:33.646567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124f80-b37b-4594-bf66-0e3e6cfb2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:33.646567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124f80-b37b-4594-bf66-0e3e6cfb2bf3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:33.647628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:33.653571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423a37d-52b6-4812-89c8-204dbe697c03 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:33.654144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423a37d-52b6-4812-89c8-204dbe697c03 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:33.654144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423a37d-52b6-4812-89c8-204dbe697c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:33.725462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:33.754613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2423a37d-52b6-4812-89c8-204dbe697c03 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:33.756158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2423a37d-52b6-4812-89c8-204dbe697c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:33.869631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:56:34.024919 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124f80-b37b-4594-bf66-0e3e6cfb2bf3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:34.026822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9b124f80-b37b-4594-bf66-0e3e6cfb2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:34.191772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124f80-b37b-4594-bf66-0e3e6cfb2bf3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:34.204839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:34.313674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c29da-9904-488a-b891-821decdcbcc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:34.314283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c29da-9904-488a-b891-821decdcbcc8 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:34.314579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c29da-9904-488a-b891-821decdcbcc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:34.314860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c29da-9904-488a-b891-821decdcbcc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:34.316520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-797c29da-9904-488a-b891-821decdcbcc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:34.412713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c29da-9904-488a-b891-821decdcbcc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:34.414522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c29da-9904-488a-b891-821decdcbcc8 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:34.435984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 711/1422] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:35.340223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943e63-e55f-4a44-b5c2-51ba967320fa None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:35.340835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943e63-e55f-4a44-b5c2-51ba967320fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:35.340835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943e63-e55f-4a44-b5c2-51ba967320fa None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:35.342227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:35.348161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d87b7-d063-4d55-9451-995121ca5a1f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:35.348609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d87b7-d063-4d55-9451-995121ca5a1f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:35.348852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d87b7-d063-4d55-9451-995121ca5a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:35.369647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:35.438576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a65d87b7-d063-4d55-9451-995121ca5a1f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:35.439826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a65d87b7-d063-4d55-9451-995121ca5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:35.579468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:35.735502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04943e63-e55f-4a44-b5c2-51ba967320fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:35.737110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-04943e63-e55f-4a44-b5c2-51ba967320fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:35.862579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:35.901421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04943e63-e55f-4a44-b5c2-51ba967320fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:36.019811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bb3a7-a8dd-42c5-b78b-4f51881aa355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:36.020322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb3a7-a8dd-42c5-b78b-4f51881aa355 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:36.020602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb3a7-a8dd-42c5-b78b-4f51881aa355 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:36.020930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb3a7-a8dd-42c5-b78b-4f51881aa355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:36.022775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-118bb3a7-a8dd-42c5-b78b-4f51881aa355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:36.100191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:36.114072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bb3a7-a8dd-42c5-b78b-4f51881aa355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:36.115691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bb3a7-a8dd-42c5-b78b-4f51881aa355 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:36.138245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 713/1425] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:56:37.060512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9603adb-a815-4d60-8665-6029cb6ec1c4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:37.061078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9603adb-a815-4d60-8665-6029cb6ec1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:37.061078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9603adb-a815-4d60-8665-6029cb6ec1c4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:37.062472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:37.067729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c432-90cf-45f4-8560-9a6acbb8047d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:37.068186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c432-90cf-45f4-8560-9a6acbb8047d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:37.068320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9c432-90cf-45f4-8560-9a6acbb8047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:37.164958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-01b9c432-90cf-45f4-8560-9a6acbb8047d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:37.166117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-01b9c432-90cf-45f4-8560-9a6acbb8047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:37.266791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:37.415752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9603adb-a815-4d60-8665-6029cb6ec1c4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:37.417214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9603adb-a815-4d60-8665-6029cb6ec1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:37.505538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:37.571053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9603adb-a815-4d60-8665-6029cb6ec1c4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:37.686251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cf86b-d6bc-4689-9161-e97400d0c70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:37.686905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf86b-d6bc-4689-9161-e97400d0c70d service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:37.687186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf86b-d6bc-4689-9161-e97400d0c70d service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:37.687461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cf86b-d6bc-4689-9161-e97400d0c70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:37.689187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a8cf86b-d6bc-4689-9161-e97400d0c70d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:37.740111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:37.785065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cf86b-d6bc-4689-9161-e97400d0c70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:37.786729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cf86b-d6bc-4689-9161-e97400d0c70d service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:37.805966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 714/1428] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:38.623291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1995-5216-4481-a7ff-920331c0ccb2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:38.623882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1995-5216-4481-a7ff-920331c0ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:38.623995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b1995-5216-4481-a7ff-920331c0ccb2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:38.625589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:38 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:38.630763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b531-62a6-4a99-b3a0-6202563d26be None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:38.631260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b531-62a6-4a99-b3a0-6202563d26be None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:38.631395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935b531-62a6-4a99-b3a0-6202563d26be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:38.726512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c935b531-62a6-4a99-b3a0-6202563d26be None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:38.727784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c935b531-62a6-4a99-b3a0-6202563d26be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:38.851171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:39.001552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b1995-5216-4481-a7ff-920331c0ccb2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:39.003162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3d8b1995-5216-4481-a7ff-920331c0ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:39.061009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:39.176093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b1995-5216-4481-a7ff-920331c0ccb2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:39.299644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4c140-8258-49d4-8a19-af1597ab6bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:39.300275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c140-8258-49d4-8a19-af1597ab6bb5 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:39.300554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c140-8258-49d4-8a19-af1597ab6bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:39.300827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4c140-8258-49d4-8a19-af1597ab6bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:39.302547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c2f4c140-8258-49d4-8a19-af1597ab6bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:39.311676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:39.413923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4c140-8258-49d4-8a19-af1597ab6bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:39.415591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4c140-8258-49d4-8a19-af1597ab6bb5 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:39.434928 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 716/1431] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:40.265246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e315-91fd-4ff5-bba6-7e2d9c4a649a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:40.265800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e315-91fd-4ff5-bba6-7e2d9c4a649a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:40.265800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6e315-91fd-4ff5-bba6-7e2d9c4a649a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:40.267311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:40.276769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc78b2-e748-4735-b4cb-1a8bcd00c5bf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:40.277254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc78b2-e748-4735-b4cb-1a8bcd00c5bf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:40.277362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc78b2-e748-4735-b4cb-1a8bcd00c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:40.353102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-69bc78b2-e748-4735-b4cb-1a8bcd00c5bf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:40.354377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-69bc78b2-e748-4735-b4cb-1a8bcd00c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:40.428959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:40.460106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:40.616564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e315-91fd-4ff5-bba6-7e2d9c4a649a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:40.618093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2aa6e315-91fd-4ff5-bba6-7e2d9c4a649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:40.638143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:40.807828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6e315-91fd-4ff5-bba6-7e2d9c4a649a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:40.901248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:40.929321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57324ed-028d-4678-97fd-afa47be0cc53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:40.929958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57324ed-028d-4678-97fd-afa47be0cc53 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:40.930317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57324ed-028d-4678-97fd-afa47be0cc53 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:40.938871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57324ed-028d-4678-97fd-afa47be0cc53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:40.938871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e57324ed-028d-4678-97fd-afa47be0cc53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:41.029909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57324ed-028d-4678-97fd-afa47be0cc53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:41.031882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57324ed-028d-4678-97fd-afa47be0cc53 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:41.050733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 717/1434] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:41.866680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314eb07-d5f9-4d05-bab0-0ce160ed56da None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:41.867247 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314eb07-d5f9-4d05-bab0-0ce160ed56da None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:41.867247 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314eb07-d5f9-4d05-bab0-0ce160ed56da None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:41.869043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:41.874217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561356a-1619-4436-9f29-fd81d8e4fe1d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:41.874709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561356a-1619-4436-9f29-fd81d8e4fe1d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:41.874820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561356a-1619-4436-9f29-fd81d8e4fe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:41.954065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1561356a-1619-4436-9f29-fd81d8e4fe1d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:41.955311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1561356a-1619-4436-9f29-fd81d8e4fe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:41.998870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:42.064258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:42.218521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314eb07-d5f9-4d05-bab0-0ce160ed56da None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:42.220149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1314eb07-d5f9-4d05-bab0-0ce160ed56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:42.371875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314eb07-d5f9-4d05-bab0-0ce160ed56da None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:42.430507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:42.490833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fdd9e-d30a-4816-9c5b-297219210dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:42.491364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdd9e-d30a-4816-9c5b-297219210dca service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:42.491647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdd9e-d30a-4816-9c5b-297219210dca service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:42.491920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fdd9e-d30a-4816-9c5b-297219210dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:42.493610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fc9fdd9e-d30a-4816-9c5b-297219210dca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:42.597978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fdd9e-d30a-4816-9c5b-297219210dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:42.599616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fdd9e-d30a-4816-9c5b-297219210dca service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:42.619031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 719/1437] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:43.424213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581926-0538-4276-8853-d3461a5881e9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:43.424972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581926-0538-4276-8853-d3461a5881e9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:43.424972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5581926-0538-4276-8853-d3461a5881e9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:43.426334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 16:56:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:43.431958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d444e-4d4a-4184-8b41-5139e0835d85 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:43.432412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d444e-4d4a-4184-8b41-5139e0835d85 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:43.432531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d444e-4d4a-4184-8b41-5139e0835d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:43.510289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8a7d444e-4d4a-4184-8b41-5139e0835d85 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:43.511612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8a7d444e-4d4a-4184-8b41-5139e0835d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:43.513959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:43.616614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 16:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:56:43.774032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5581926-0538-4276-8853-d3461a5881e9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:43.776157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c5581926-0538-4276-8853-d3461a5881e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:43.936801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5581926-0538-4276-8853-d3461a5881e9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:43.964529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:44.055338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5f1ae-44fa-4525-b5c9-5e356d0129f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:44.055880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f1ae-44fa-4525-b5c9-5e356d0129f3 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:44.056692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f1ae-44fa-4525-b5c9-5e356d0129f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:44.056966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5f1ae-44fa-4525-b5c9-5e356d0129f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:44.058651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dcb5f1ae-44fa-4525-b5c9-5e356d0129f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:44.155195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f1ae-44fa-4525-b5c9-5e356d0129f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:44.156819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5f1ae-44fa-4525-b5c9-5e356d0129f3 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:44.175158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 720/1440] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:46.098063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252a61-51d6-4a66-b92b-5ac152831445 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:46.098671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252a61-51d6-4a66-b92b-5ac152831445 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:46.098671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252a61-51d6-4a66-b92b-5ac152831445 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:46.100042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:56:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:46.105855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee3c3-7a7d-473a-9488-aaa763495f09 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:46.106358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee3c3-7a7d-473a-9488-aaa763495f09 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:46.106358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee3c3-7a7d-473a-9488-aaa763495f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:46.151096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:46.183270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-00cee3c3-7a7d-473a-9488-aaa763495f09 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:46.184575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-00cee3c3-7a7d-473a-9488-aaa763495f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:46.290240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:46.331306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c252a61-51d6-4a66-b92b-5ac152831445 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:46.332104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0c252a61-51d6-4a66-b92b-5ac152831445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:46.441588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c252a61-51d6-4a66-b92b-5ac152831445 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:46.474455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:46.522134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5f2c7-6e23-41ea-8608-1b2df09dc586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:46.522791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f2c7-6e23-41ea-8608-1b2df09dc586 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:46.523078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f2c7-6e23-41ea-8608-1b2df09dc586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:46.523355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f2c7-6e23-41ea-8608-1b2df09dc586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:46.525040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-55c5f2c7-6e23-41ea-8608-1b2df09dc586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:46.660399 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5f2c7-6e23-41ea-8608-1b2df09dc586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:46.661869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5f2c7-6e23-41ea-8608-1b2df09dc586 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:46.681866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 722/1443] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:48.926976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549629-b6a0-425e-abda-1184a5a00768 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:48.927531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549629-b6a0-425e-abda-1184a5a00768 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:48.927531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549629-b6a0-425e-abda-1184a5a00768 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:48.928897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:56:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:48.934105 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33450-ce78-4e5e-aceb-99cdeeafa6a0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:48.934585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33450-ce78-4e5e-aceb-99cdeeafa6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:48.934776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae33450-ce78-4e5e-aceb-99cdeeafa6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:49.000864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3ae33450-ce78-4e5e-aceb-99cdeeafa6a0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:49.001990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3ae33450-ce78-4e5e-aceb-99cdeeafa6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:49.015526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:49.102910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:49.141590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f549629-b6a0-425e-abda-1184a5a00768 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:49.143277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4f549629-b6a0-425e-abda-1184a5a00768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:49.251834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f549629-b6a0-425e-abda-1184a5a00768 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:49.264644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:49.327005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fb47-85ff-4011-a0d7-5bd373fa82d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:49.327628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fb47-85ff-4011-a0d7-5bd373fa82d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:49.327909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fb47-85ff-4011-a0d7-5bd373fa82d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:49.328188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fb47-85ff-4011-a0d7-5bd373fa82d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:49.329789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6371fb47-85ff-4011-a0d7-5bd373fa82d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:49.439387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fb47-85ff-4011-a0d7-5bd373fa82d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:49.440828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fb47-85ff-4011-a0d7-5bd373fa82d2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:49.458861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 723/1446] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:51.812640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19914453-b466-4963-86a9-2e84e390798d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:51.813219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19914453-b466-4963-86a9-2e84e390798d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:51.813219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19914453-b466-4963-86a9-2e84e390798d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:51.814581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:56:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:51.819992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1910-8dfb-468f-aa5d-69e87ee28131 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:51.820450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1910-8dfb-468f-aa5d-69e87ee28131 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:51.820558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de1910-8dfb-468f-aa5d-69e87ee28131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:51.869491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:51.888281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-73de1910-8dfb-468f-aa5d-69e87ee28131 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:51.889763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-73de1910-8dfb-468f-aa5d-69e87ee28131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:52.002547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:52.042572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19914453-b466-4963-86a9-2e84e390798d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:52.044207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-19914453-b466-4963-86a9-2e84e390798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:52.152246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19914453-b466-4963-86a9-2e84e390798d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:52.196803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:52.234216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31902975-98ac-450c-861b-650bf42f87be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:52.234914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902975-98ac-450c-861b-650bf42f87be service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:52.235202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902975-98ac-450c-861b-650bf42f87be service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:52.235494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902975-98ac-450c-861b-650bf42f87be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:52.237149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-31902975-98ac-450c-861b-650bf42f87be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:52.376947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31902975-98ac-450c-861b-650bf42f87be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:52.378415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31902975-98ac-450c-861b-650bf42f87be service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:52.397422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 725/1449] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:54.564384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecd598-b599-434d-a492-a799098e3f43 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:54.564929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecd598-b599-434d-a492-a799098e3f43 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:54.565316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecd598-b599-434d-a492-a799098e3f43 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:54.567352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:56:54 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:54.574696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573929-9b3a-40f1-85b6-e1cf0332388c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:54.575203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573929-9b3a-40f1-85b6-e1cf0332388c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:54.575302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573929-9b3a-40f1-85b6-e1cf0332388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:54.644957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ee573929-9b3a-40f1-85b6-e1cf0332388c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:54.646180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee573929-9b3a-40f1-85b6-e1cf0332388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:54.668419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:54.747288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:56:54.785525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecd598-b599-434d-a492-a799098e3f43 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:54.787104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-92ecd598-b599-434d-a492-a799098e3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:54.889742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecd598-b599-434d-a492-a799098e3f43 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:54.910751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:54.964721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabc69b-e4b8-45b4-a427-554c45ae24c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:54.965342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc69b-e4b8-45b4-a427-554c45ae24c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:54.965623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc69b-e4b8-45b4-a427-554c45ae24c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:54.965918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc69b-e4b8-45b4-a427-554c45ae24c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:54.967559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bfabc69b-e4b8-45b4-a427-554c45ae24c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:55.200114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabc69b-e4b8-45b4-a427-554c45ae24c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:55.201556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabc69b-e4b8-45b4-a427-554c45ae24c6 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:55.220114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 726/1452] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:57.307008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8c3c4-9b15-484d-9586-5652ae35eaa8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:57.307566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8c3c4-9b15-484d-9586-5652ae35eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:57.307704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8c3c4-9b15-484d-9586-5652ae35eaa8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:57.308971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:56:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:57.314614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9fff0-12fd-4454-88af-f070e1629c25 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:57.315093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9fff0-12fd-4454-88af-f070e1629c25 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:57.315190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9fff0-12fd-4454-88af-f070e1629c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:57.377654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:57.381527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eac9fff0-12fd-4454-88af-f070e1629c25 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:56:57.383926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eac9fff0-12fd-4454-88af-f070e1629c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:57.489771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:56:57.529514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8c3c4-9b15-484d-9586-5652ae35eaa8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:56:57.531129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7ad8c3c4-9b15-484d-9586-5652ae35eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:57.647126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8c3c4-9b15-484d-9586-5652ae35eaa8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:56:57.698525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:56:57.729841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635f026-3ffa-4940-8ba7-05f1bd656060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:56:57.730516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635f026-3ffa-4940-8ba7-05f1bd656060 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:57.730799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635f026-3ffa-4940-8ba7-05f1bd656060 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:57.731077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635f026-3ffa-4940-8ba7-05f1bd656060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:57.732771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2635f026-3ffa-4940-8ba7-05f1bd656060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:56:57.857755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635f026-3ffa-4940-8ba7-05f1bd656060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:56:57.859249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635f026-3ffa-4940-8ba7-05f1bd656060 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:56:57.878675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 728/1455] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:56:59.963815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf9d4d-4e80-44b9-a7a3-da323074c2e8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:59.964392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf9d4d-4e80-44b9-a7a3-da323074c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:59.964392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf9d4d-4e80-44b9-a7a3-da323074c2e8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:56:59.965699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:56:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:56:59.971504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb988-d9fb-403e-aeff-7e37d22c17cc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:56:59.971955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb988-d9fb-403e-aeff-7e37d22c17cc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:56:59.972073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb988-d9fb-403e-aeff-7e37d22c17cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:00.047919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-207fb988-d9fb-403e-aeff-7e37d22c17cc None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:00.049173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-207fb988-d9fb-403e-aeff-7e37d22c17cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:00.083853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:00.165009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:00.203510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf9d4d-4e80-44b9-a7a3-da323074c2e8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:00.205076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0edf9d4d-4e80-44b9-a7a3-da323074c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:00.310999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf9d4d-4e80-44b9-a7a3-da323074c2e8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:00.342982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:00.389820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efeb3-cfe3-4de0-bdf8-5c805256d16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:00.390487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efeb3-cfe3-4de0-bdf8-5c805256d16a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:00.390778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efeb3-cfe3-4de0-bdf8-5c805256d16a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:00.391050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efeb3-cfe3-4de0-bdf8-5c805256d16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:00.392744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-821efeb3-cfe3-4de0-bdf8-5c805256d16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:00.499509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efeb3-cfe3-4de0-bdf8-5c805256d16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:00.500964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efeb3-cfe3-4de0-bdf8-5c805256d16a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:00.519211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 729/1458] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:02.654545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a38e20-562b-4784-b426-5fa34bd2e714 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:02.655138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a38e20-562b-4784-b426-5fa34bd2e714 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:02.655138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a38e20-562b-4784-b426-5fa34bd2e714 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:02.656481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:57:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:02.661819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65baf2-a3d7-48ad-ac71-dcd84a04fc2a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:02.662217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65baf2-a3d7-48ad-ac71-dcd84a04fc2a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:02.662418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65baf2-a3d7-48ad-ac71-dcd84a04fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:02.727231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eb65baf2-a3d7-48ad-ac71-dcd84a04fc2a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:02.728555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eb65baf2-a3d7-48ad-ac71-dcd84a04fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:02.737496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:02.824447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:02.863498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a38e20-562b-4784-b426-5fa34bd2e714 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:02.865123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-80a38e20-562b-4784-b426-5fa34bd2e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:02.977118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a38e20-562b-4784-b426-5fa34bd2e714 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:03.033723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:03.052960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ccc3a-5a50-4657-be42-7ecd0779a2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:03.053587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ccc3a-5a50-4657-be42-7ecd0779a2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:03.053868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ccc3a-5a50-4657-be42-7ecd0779a2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:03.054141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ccc3a-5a50-4657-be42-7ecd0779a2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:03.055792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d87ccc3a-5a50-4657-be42-7ecd0779a2d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:03.164849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ccc3a-5a50-4657-be42-7ecd0779a2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:03.166371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ccc3a-5a50-4657-be42-7ecd0779a2d4 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:03.184575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 731/1461] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:05.337058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57011-a0ba-4a54-8505-654d2d833745 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:05.337670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57011-a0ba-4a54-8505-654d2d833745 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:05.337670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57011-a0ba-4a54-8505-654d2d833745 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:05.339634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:57:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:05.345598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793d09-07a5-40ef-9561-814bbe3c9d58 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:05.346084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793d09-07a5-40ef-9561-814bbe3c9d58 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:05.346220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793d09-07a5-40ef-9561-814bbe3c9d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:05.417613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cb793d09-07a5-40ef-9561-814bbe3c9d58 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:05.418991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cb793d09-07a5-40ef-9561-814bbe3c9d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:05.461687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:05.537123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:05.576446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57011-a0ba-4a54-8505-654d2d833745 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:05.579067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8fb57011-a0ba-4a54-8505-654d2d833745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:05.704214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57011-a0ba-4a54-8505-654d2d833745 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:05.744676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:05.783056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a0089-cab9-478d-a73c-d1f393f40d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:05.783695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a0089-cab9-478d-a73c-d1f393f40d68 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:05.783979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a0089-cab9-478d-a73c-d1f393f40d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:05.784253 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a0089-cab9-478d-a73c-d1f393f40d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:05.785894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f52a0089-cab9-478d-a73c-d1f393f40d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:05.895683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a0089-cab9-478d-a73c-d1f393f40d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:05.897112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a0089-cab9-478d-a73c-d1f393f40d68 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:05.917537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 732/1464] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:07.997125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed2115-ec5b-4c2f-a4b4-b5e6aabd05f6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:07.997691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed2115-ec5b-4c2f-a4b4-b5e6aabd05f6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:07.997691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed2115-ec5b-4c2f-a4b4-b5e6aabd05f6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:07.999107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:57:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:08.004705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6788b-d08c-4434-a720-21ed57c5a1c1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:08.005150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6788b-d08c-4434-a720-21ed57c5a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:08.005243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6788b-d08c-4434-a720-21ed57c5a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:08.100568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b3c6788b-d08c-4434-a720-21ed57c5a1c1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:08.101799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3c6788b-d08c-4434-a720-21ed57c5a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:08.133944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:08.219935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:08.266284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed2115-ec5b-4c2f-a4b4-b5e6aabd05f6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:08.267967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-04ed2115-ec5b-4c2f-a4b4-b5e6aabd05f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:08.381392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed2115-ec5b-4c2f-a4b4-b5e6aabd05f6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:08.462344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:08.470704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5fafa-ec39-4c9c-a64c-97977ecf3817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:08.471298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fafa-ec39-4c9c-a64c-97977ecf3817 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:08.471583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fafa-ec39-4c9c-a64c-97977ecf3817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:08.471858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5fafa-ec39-4c9c-a64c-97977ecf3817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:08.473548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e5d5fafa-ec39-4c9c-a64c-97977ecf3817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:08.590454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fafa-ec39-4c9c-a64c-97977ecf3817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:08.591854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5fafa-ec39-4c9c-a64c-97977ecf3817 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:08.611474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 734/1467] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:10.682831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9527-5c29-4fa4-bf2b-1b22dcc598cc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:10.683414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9527-5c29-4fa4-bf2b-1b22dcc598cc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:10.683414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec9527-5c29-4fa4-bf2b-1b22dcc598cc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:10.684742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 16:57:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:10.690174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c3927-c36d-411c-894b-dd4654e87532 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:10.690747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c3927-c36d-411c-894b-dd4654e87532 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:10.690879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c3927-c36d-411c-894b-dd4654e87532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:10.763582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4b4c3927-c36d-411c-894b-dd4654e87532 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:10.765048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4b4c3927-c36d-411c-894b-dd4654e87532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:10.818091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:10.881086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 16:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:10.919475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9527-5c29-4fa4-bf2b-1b22dcc598cc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:10.921086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93ec9527-5c29-4fa4-bf2b-1b22dcc598cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:11.033971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec9527-5c29-4fa4-bf2b-1b22dcc598cc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:11.099090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:11.128025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c988bd5-6e92-4115-93aa-762cf0f3a381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:11.128657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988bd5-6e92-4115-93aa-762cf0f3a381 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:11.128935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988bd5-6e92-4115-93aa-762cf0f3a381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:11.129202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988bd5-6e92-4115-93aa-762cf0f3a381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:11.130846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7c988bd5-6e92-4115-93aa-762cf0f3a381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:11.246004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c988bd5-6e92-4115-93aa-762cf0f3a381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:11.247632 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c988bd5-6e92-4115-93aa-762cf0f3a381 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:11.267299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 735/1470] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:20.879267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=22 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:21.264676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=66 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:31.497155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126205c-9be6-41af-a944-04b19e49e112 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:31.498055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126205c-9be6-41af-a944-04b19e49e112 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:31.498383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126205c-9be6-41af-a944-04b19e49e112 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:31.500107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 736/1471] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:57:31 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:31.506139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78e16-3717-41d4-9fad-709f328167a7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:31.506705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78e16-3717-41d4-9fad-709f328167a7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:31.506803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f78e16-3717-41d4-9fad-709f328167a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:31.582981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-08f78e16-3717-41d4-9fad-709f328167a7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:31.584216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-08f78e16-3717-41d4-9fad-709f328167a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:31.692730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 736/1472] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:31.797235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfc93-db8c-4d06-89f2-c0de881a53ad None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:31.797520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfc93-db8c-4d06-89f2-c0de881a53ad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:31.797800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfc93-db8c-4d06-89f2-c0de881a53ad None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:31.799402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 737/1473] 10.222.0.121 () {54 vars in 971 bytes} [Mon Aug 1 16:57:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:31.805219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dde382-5fe4-4cb8-84f3-9bda7a594f96 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:31.805516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dde382-5fe4-4cb8-84f3-9bda7a594f96 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:31.805799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dde382-5fe4-4cb8-84f3-9bda7a594f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:31.889636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c8dde382-5fe4-4cb8-84f3-9bda7a594f96 None None] MFA Rules not processed for user `bf25e3be640643c1a11fc21e08efdc70`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:31.891525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c8dde382-5fe4-4cb8-84f3-9bda7a594f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:31.914167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:31.975517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 737/1474] 10.222.0.121 () {58 vars in 1068 bytes} [Mon Aug 1 16:57:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:31.984133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bfc93-db8c-4d06-89f2-c0de881a53ad None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:31.985670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-542bfc93-db8c-4d06-89f2-c0de881a53ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:32.113513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bfc93-db8c-4d06-89f2-c0de881a53ad None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:32.204621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d296efb-655e-44e5-8f98-d3ecf5f1e2fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:32.205253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296efb-655e-44e5-8f98-d3ecf5f1e2fb service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:32.205533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296efb-655e-44e5-8f98-d3ecf5f1e2fb service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:32.205808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296efb-655e-44e5-8f98-d3ecf5f1e2fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:32.207525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2d296efb-655e-44e5-8f98-d3ecf5f1e2fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:32.265447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:32.323685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d296efb-655e-44e5-8f98-d3ecf5f1e2fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:32.325233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d296efb-655e-44e5-8f98-d3ecf5f1e2fb service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:32.345308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 738/1475] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:34.525206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfc09-fb0e-4fa4-8869-c6081de1a2b4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:34.525901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfc09-fb0e-4fa4-8869-c6081de1a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:34.525901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cfc09-fb0e-4fa4-8869-c6081de1a2b4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:34.527246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 738/1476] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:57:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:34.533892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ce1c4-170e-4409-884f-c76ff7cd7766 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:34.534508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ce1c4-170e-4409-884f-c76ff7cd7766 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:34.534508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ce1c4-170e-4409-884f-c76ff7cd7766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:34.614469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-007ce1c4-170e-4409-884f-c76ff7cd7766 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:34.616548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-007ce1c4-170e-4409-884f-c76ff7cd7766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:34.757236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 739/1477] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:34.781659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfc09-fb0e-4fa4-8869-c6081de1a2b4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:34.783178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-630cfc09-fb0e-4fa4-8869-c6081de1a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:34.942417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cfc09-fb0e-4fa4-8869-c6081de1a2b4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:35.007738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:35.074681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76becb-8856-4d60-9834-c676b6c87930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:35.075217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76becb-8856-4d60-9834-c676b6c87930 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:35.075503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76becb-8856-4d60-9834-c676b6c87930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:35.075781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76becb-8856-4d60-9834-c676b6c87930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:35.076475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76becb-8856-4d60-9834-c676b6c87930 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:35.078237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-6c76becb-8856-4d60-9834-c676b6c87930 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:57:35.078237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 16:57:35.078237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 16:57:35.079475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76becb-8856-4d60-9834-c676b6c87930 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:35.101161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 739/1478] 10.222.0.121 () {56 vars in 1113 bytes} [Mon Aug 1 16:57:34 2022] GET /identity/v3/projects => generated 2562 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:57:37.217739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2b18-2489-4862-9f8f-181b5715d3a9 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:37.218415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2b18-2489-4862-9f8f-181b5715d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:37.218415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2b18-2489-4862-9f8f-181b5715d3a9 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:37.219716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 740/1479] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:57:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:37.225665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dba70-70d3-44d0-8c5e-5623282d4c6f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:37.226428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dba70-70d3-44d0-8c5e-5623282d4c6f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:37.226428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dba70-70d3-44d0-8c5e-5623282d4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:37.304971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-959dba70-70d3-44d0-8c5e-5623282d4c6f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:37.306225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-959dba70-70d3-44d0-8c5e-5623282d4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:37.419821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 740/1480] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:37.471935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e2b18-2489-4862-9f8f-181b5715d3a9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:37.473671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-776e2b18-2489-4862-9f8f-181b5715d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:37.484776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:37.656809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e2b18-2489-4862-9f8f-181b5715d3a9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:37.742024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:37.785250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2d877-4dc9-4c87-b824-7acb718f96cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:37.785886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d877-4dc9-4c87-b824-7acb718f96cc service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:37.786172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d877-4dc9-4c87-b824-7acb718f96cc service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:37.786480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2d877-4dc9-4c87-b824-7acb718f96cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:37.788174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-03c2d877-4dc9-4c87-b824-7acb718f96cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:37.898801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2d877-4dc9-4c87-b824-7acb718f96cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:37.901604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2d877-4dc9-4c87-b824-7acb718f96cc service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:37.928014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 741/1481] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:40.235032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f7eb4-c388-46a7-802e-a29fc322df3f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:40.235674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f7eb4-c388-46a7-802e-a29fc322df3f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:40.235674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f7eb4-c388-46a7-802e-a29fc322df3f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:40.237201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 741/1482] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:57:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:40.243520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840620ad-646e-4abf-8dd8-57dacf1d7dd9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:40.244027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840620ad-646e-4abf-8dd8-57dacf1d7dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:40.244143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840620ad-646e-4abf-8dd8-57dacf1d7dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:40.320952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-840620ad-646e-4abf-8dd8-57dacf1d7dd9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:40.322214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-840620ad-646e-4abf-8dd8-57dacf1d7dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:40.378817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:40.434148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 742/1483] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:40.471699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f7eb4-c388-46a7-802e-a29fc322df3f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:40.473311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-098f7eb4-c388-46a7-802e-a29fc322df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:40.497727 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:40.587860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f7eb4-c388-46a7-802e-a29fc322df3f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:40.663965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d73f3-c112-4845-bcd0-4e4c3fbe8bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:40.664617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d73f3-c112-4845-bcd0-4e4c3fbe8bfd service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:40.664941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d73f3-c112-4845-bcd0-4e4c3fbe8bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:40.665216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d73f3-c112-4845-bcd0-4e4c3fbe8bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:40.667000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cc4d73f3-c112-4845-bcd0-4e4c3fbe8bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:40.748675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:40.786364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d73f3-c112-4845-bcd0-4e4c3fbe8bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:40.787846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d73f3-c112-4845-bcd0-4e4c3fbe8bfd service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:40.809064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 742/1484] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:42.919963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e694f1-8181-4ab4-ad52-95bdee717c64 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:42.920552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e694f1-8181-4ab4-ad52-95bdee717c64 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:42.920552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e694f1-8181-4ab4-ad52-95bdee717c64 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:42.921967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 743/1485] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:57:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:42.928133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813f164-9c06-4686-851f-8904c121eb52 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:42.928618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813f164-9c06-4686-851f-8904c121eb52 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:42.928832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813f164-9c06-4686-851f-8904c121eb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:43.001034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2813f164-9c06-4686-851f-8904c121eb52 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:43.002310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2813f164-9c06-4686-851f-8904c121eb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:43.116575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 743/1486] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:43.158098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e694f1-8181-4ab4-ad52-95bdee717c64 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:43.160033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-45e694f1-8181-4ab4-ad52-95bdee717c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:43.269106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e694f1-8181-4ab4-ad52-95bdee717c64 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:43.345528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:43.347454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e243924-d2ad-46c3-af3a-064085fdec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:43.348088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e243924-d2ad-46c3-af3a-064085fdec3b service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:43.348597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e243924-d2ad-46c3-af3a-064085fdec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:43.348942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e243924-d2ad-46c3-af3a-064085fdec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:43.351120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9e243924-d2ad-46c3-af3a-064085fdec3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:43.479955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e243924-d2ad-46c3-af3a-064085fdec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:43.481431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e243924-d2ad-46c3-af3a-064085fdec3b service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:43.501008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 744/1487] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:57:45.648254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427164-38f5-4af3-8eac-c9cff7f513d4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:45.648800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427164-38f5-4af3-8eac-c9cff7f513d4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:45.648800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427164-38f5-4af3-8eac-c9cff7f513d4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:45.650167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 744/1488] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:57:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:45.655604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c1d97-c8d5-45ce-b7a2-63796227bcdf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:45.656054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c1d97-c8d5-45ce-b7a2-63796227bcdf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:45.656157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c1d97-c8d5-45ce-b7a2-63796227bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:45.723780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f05c1d97-c8d5-45ce-b7a2-63796227bcdf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:45.725007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f05c1d97-c8d5-45ce-b7a2-63796227bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:45.779217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:45.825420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 745/1489] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:57:45.865011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427164-38f5-4af3-8eac-c9cff7f513d4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:45.866638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93427164-38f5-4af3-8eac-c9cff7f513d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:45.905055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:45.982014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93427164-38f5-4af3-8eac-c9cff7f513d4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:46.055739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a880cd-20b4-450a-b541-6dcec6fbbe88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:46.056426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a880cd-20b4-450a-b541-6dcec6fbbe88 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:46.056739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a880cd-20b4-450a-b541-6dcec6fbbe88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:46.057018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a880cd-20b4-450a-b541-6dcec6fbbe88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:46.058735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a1a880cd-20b4-450a-b541-6dcec6fbbe88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:46.143802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:46.174568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a880cd-20b4-450a-b541-6dcec6fbbe88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:46.176021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a880cd-20b4-450a-b541-6dcec6fbbe88 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:46.193934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 745/1490] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:48.475103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c725f8-164f-488e-a383-6daeb7ec29f8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:48.475880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c725f8-164f-488e-a383-6daeb7ec29f8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:48.475880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c725f8-164f-488e-a383-6daeb7ec29f8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:48.477063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 746/1491] 10.222.0.121 () {54 vars in 931 bytes} [Mon Aug 1 16:57:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:57:48.482572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84449-5680-4a6f-84d6-a28ee3c46572 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:48.483065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84449-5680-4a6f-84d6-a28ee3c46572 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:48.483219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84449-5680-4a6f-84d6-a28ee3c46572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:48.554184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dde84449-5680-4a6f-84d6-a28ee3c46572 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:57:48.555435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dde84449-5680-4a6f-84d6-a28ee3c46572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:48.663685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 746/1492] 10.222.0.121 () {58 vars in 1028 bytes} [Mon Aug 1 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:57:48.713048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c725f8-164f-488e-a383-6daeb7ec29f8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:57:48.714647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-19c725f8-164f-488e-a383-6daeb7ec29f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:48.831440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c725f8-164f-488e-a383-6daeb7ec29f8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:57:48.909365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a720cf-a3cd-4ad1-98e1-66a0e032b621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:57:48.909992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a720cf-a3cd-4ad1-98e1-66a0e032b621 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:57:48.910294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a720cf-a3cd-4ad1-98e1-66a0e032b621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:57:48.910578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a720cf-a3cd-4ad1-98e1-66a0e032b621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:57:48.912213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-36a720cf-a3cd-4ad1-98e1-66a0e032b621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:57:48.921923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:49.030543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a720cf-a3cd-4ad1-98e1-66a0e032b621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:57:49.031904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a720cf-a3cd-4ad1-98e1-66a0e032b621 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:57:49.050974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 747/1493] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:57:58.661802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=82 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:57:59.048450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=50 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:21.505936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:21.506890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:21.507063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:21.630325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:21.631748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:21.784699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 747/1494] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:21.794953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c6c9-f3fe-4665-b41b-50737e50875b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:21.795844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c6c9-f3fe-4665-b41b-50737e50875b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:21.795844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c6c9-f3fe-4665-b41b-50737e50875b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:21.926980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d584c6c9-f3fe-4665-b41b-50737e50875b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:21.928859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d584c6c9-f3fe-4665-b41b-50737e50875b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:22.051412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 748/1495] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:22.056710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:22.057965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:22.071261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f08fc-fe94-4a4c-b9cb-ef0bfde02e8f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:22.158418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:22.209160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:22.209836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:22.210129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:22.210443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:22.211170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 16:59:22.211479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:22.212532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:22.212532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 16:59:22.212532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 16:59:22.213452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:22.237224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 748/1496] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 16:59:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 16:59:22.252379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c6c9-f3fe-4665-b41b-50737e50875b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:22.265072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c6c9-f3fe-4665-b41b-50737e50875b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:22.374314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:22.444685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:22.445760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:22.446224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:22.446773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:22.448063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:22.451330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:22.451330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: warnings.warn(msg) Aug 01 16:59:22.451330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: Aug 01 16:59:22.453464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:22.560463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 749/1497] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 16:59:22 2022] POST /identity/v3/projects => generated 378 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 16:59:22.565097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:22.566754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:22.611392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebe12a-22b4-48c9-99cf-81133e0a2f80 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:22.728311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:22.728961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:22.729250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:22.729535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:22.730231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:22.731301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:22.731301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 16:59:22.731301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 16:59:22.733099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:22.786358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 749/1498] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 16:59:22 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 16:59:22.791551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:22.794326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:22.904967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf343c-6982-454a-8fcd-c6805e46c3b0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:23.026148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:23.040694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:23.041335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:23.041608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:23.041889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:23.042659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:23.043685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:23.043685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: warnings.warn(msg) Aug 01 16:59:23.043685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: Aug 01 16:59:23.044671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:23.062508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 750/1499] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 16:59:22 2022] GET /identity/v3/roles => generated 1427 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 16:59:23.065185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:23.066967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:23.080184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea810113-42b8-4c36-a1d3-378e5814bdfe admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:23.121056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:23.259760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c251f5-b5a7-4a32-a359-7050e3604c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:23.260841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c251f5-b5a7-4a32-a359-7050e3604c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:23.261330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c251f5-b5a7-4a32-a359-7050e3604c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:23.261807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c251f5-b5a7-4a32-a359-7050e3604c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:23.263148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c251f5-b5a7-4a32-a359-7050e3604c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:23.265163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-a3c251f5-b5a7-4a32-a359-7050e3604c6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:23.265163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 16:59:23.265163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 16:59:23.266102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c251f5-b5a7-4a32-a359-7050e3604c6c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:23.289844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 750/1500] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 16:59:23 2022] GET /identity/v3/roles => generated 1427 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 16:59:23.296288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:23.298102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:23.344493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a0549-5d1d-458d-876d-3b6b5437527e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:23.485353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a5ded-b6a8-436c-a178-8a60417af7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:23.486047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a5ded-b6a8-436c-a178-8a60417af7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:23.486371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a5ded-b6a8-436c-a178-8a60417af7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:23.486655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a5ded-b6a8-436c-a178-8a60417af7fb admin admin] PATH_INFO: `/v3/projects/29a11d341f874e04a96d8d347f83b263/users/bdf15ef4afd3426c9cdc65d18bc3f23d/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:23.515392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a5ded-b6a8-436c-a178-8a60417af7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a11d341f874e04a96d8d347f83b263, user_id=bdf15ef4afd3426c9cdc65d18bc3f23d, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:23.516725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-c22a5ded-b6a8-436c-a178-8a60417af7fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:23.516725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: warnings.warn(msg) Aug 01 16:59:23.516725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: Aug 01 16:59:23.518995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a5ded-b6a8-436c-a178-8a60417af7fb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:23.563678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 751/1501] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 16:59:23 2022] PUT /identity/v3/projects/29a11d341f874e04a96d8d347f83b263/users/bdf15ef4afd3426c9cdc65d18bc3f23d/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:59:23.576383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0f8f-ad94-4765-b798-dc0089cc81f0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:23.577160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0f8f-ad94-4765-b798-dc0089cc81f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:23.577160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d0f8f-ad94-4765-b798-dc0089cc81f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:23.679713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-693d0f8f-ad94-4765-b798-dc0089cc81f0 None None] MFA Rules not processed for user `bdf15ef4afd3426c9cdc65d18bc3f23d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:23.681120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-693d0f8f-ad94-4765-b798-dc0089cc81f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:23.793416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 751/1502] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:23.816896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70cca-ea8e-4855-a492-574110414a28 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:23.817424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70cca-ea8e-4855-a492-574110414a28 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:23.817724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70cca-ea8e-4855-a492-574110414a28 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:23.820115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 752/1503] 10.222.0.121 () {54 vars in 969 bytes} [Mon Aug 1 16:59:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:59:23.828565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc08f7-ddc5-47f5-a305-7c0130cdfc58 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:23.829061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc08f7-ddc5-47f5-a305-7c0130cdfc58 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:23.829572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc08f7-ddc5-47f5-a305-7c0130cdfc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:23.874064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:23.954123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cbfc08f7-ddc5-47f5-a305-7c0130cdfc58 None None] MFA Rules not processed for user `3e9b1bcc6f8e4bbdacf66021bfe57bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:23.955855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cbfc08f7-ddc5-47f5-a305-7c0130cdfc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:24.080717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 752/1504] 10.222.0.121 () {58 vars in 1066 bytes} [Mon Aug 1 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 16:59:24.089400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a70cca-ea8e-4855-a492-574110414a28 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:24.091161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-44a70cca-ea8e-4855-a492-574110414a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:24.153177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:24.247159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a70cca-ea8e-4855-a492-574110414a28 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:24.371682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:24.373154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:24.373642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:24.374139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:24.376794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:24.508774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:24.510310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:24.515191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:24.535422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 753/1505] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 16:59:24.586227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6c21-84ea-4c64-9dc1-253dcd2bc1b4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:24.586909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6c21-84ea-4c64-9dc1-253dcd2bc1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:24.587059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6c21-84ea-4c64-9dc1-253dcd2bc1b4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:24.588411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 753/1506] 10.222.0.121 () {52 vars in 835 bytes} [Mon Aug 1 16:59:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 16:59:24.594245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:24.596283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:24.725421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a93b4-2676-42ec-b76c-b6523328cd17 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:24.841747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:24.842443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:24.842723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:24.842999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] PATH_INFO: `/v3/users/bdf15ef4afd3426c9cdc65d18bc3f23d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:24.856961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf15ef4afd3426c9cdc65d18bc3f23d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:24.857998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:24.857998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: warnings.warn(msg) Aug 01 16:59:24.857998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: Aug 01 16:59:24.859275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:24.870061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:24.948770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf15ef4afd3426c9cdc65d18bc3f23d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:24.970871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf15ef4afd3426c9cdc65d18bc3f23d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:24.997145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf15ef4afd3426c9cdc65d18bc3f23d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:24.997718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf15ef4afd3426c9cdc65d18bc3f23d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:24.998277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf15ef4afd3426c9cdc65d18bc3f23d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:25.025749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 754/1507] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 16:59:24 2022] DELETE /identity/v3/users/bdf15ef4afd3426c9cdc65d18bc3f23d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:59:25.031499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:25.031825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:25.032112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:25.099640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 16:59:25.100892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:25.187870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:25.204347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 754/1508] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 16:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 16:59:25.214718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:25.215962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:25.331015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362d843-bae4-4890-965b-8683225380c8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:25.395757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:25.421453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312de93-03e7-4e1b-8673-98720b3fc12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:25.422088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312de93-03e7-4e1b-8673-98720b3fc12e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:25.422412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312de93-03e7-4e1b-8673-98720b3fc12e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:25.422712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312de93-03e7-4e1b-8673-98720b3fc12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:25.424547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5312de93-03e7-4e1b-8673-98720b3fc12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:25.585362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312de93-03e7-4e1b-8673-98720b3fc12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:25.586955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312de93-03e7-4e1b-8673-98720b3fc12e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:25.613372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 755/1509] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 16:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 16:59:26.010743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 16:59:26.013216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 16:59:26.033721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e16f-50a7-4df8-b803-00abe52e8228 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 16:59:26.155761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 16:59:26.156305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 16:59:26.156587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 16:59:26.156863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] PATH_INFO: `/v3/projects/29a11d341f874e04a96d8d347f83b263` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 16:59:26.168516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a11d341f874e04a96d8d347f83b263)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 16:59:26.170128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:59:26.170128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 16:59:26.170128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 16:59:26.171470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 16:59:26.253532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a11d341f874e04a96d8d347f83b263', 'request_id': 'req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:26.267405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a11d341f874e04a96d8d347f83b263', 'request_id': 'req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:26.278775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a11d341f874e04a96d8d347f83b263', 'request_id': 'req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:26.304217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] The token cache is being invalidate because project 29a11d341f874e04a96d8d347f83b263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 16:59:26.304507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:26.305047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-22ed6e46-cb2c-4c7d-9b0f-e61ed9821f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 16:59:26.306437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 755/1510] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 16:59:26 2022] DELETE /identity/v3/projects/29a11d341f874e04a96d8d347f83b263 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 16:59:35.610241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=62 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:59:36.302022 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:19.136254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e9b4-e79d-4574-8319-fb4de77197c0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:19.137252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e9b4-e79d-4574-8319-fb4de77197c0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:19.137252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7e9b4-e79d-4574-8319-fb4de77197c0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:19.138473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 17:01:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:19.144674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ae16-5079-422e-af71-e0791519bdf0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:19.145165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ae16-5079-422e-af71-e0791519bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:19.145279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ae16-5079-422e-af71-e0791519bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:19.228667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-70b4ae16-5079-422e-af71-e0791519bdf0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:19.229875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-70b4ae16-5079-422e-af71-e0791519bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:19.342575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 17:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:19.500714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e9b4-e79d-4574-8319-fb4de77197c0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:19.502974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-91b7e9b4-e79d-4574-8319-fb4de77197c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:19.634719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7e9b4-e79d-4574-8319-fb4de77197c0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:19.640432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6e40f-6692-4ac7-9057-38aff326f172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:19.641060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e40f-6692-4ac7-9057-38aff326f172 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:19.641347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e40f-6692-4ac7-9057-38aff326f172 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:19.641632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6e40f-6692-4ac7-9057-38aff326f172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:19.650874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6e40f-6692-4ac7-9057-38aff326f172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:19.652608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6e40f-6692-4ac7-9057-38aff326f172 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:19.663277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 757/1513] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:20.501267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b110d-4921-480c-89ae-6ac5656eab61 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:20.501853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b110d-4921-480c-89ae-6ac5656eab61 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:20.501853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b110d-4921-480c-89ae-6ac5656eab61 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:20.503228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 17:01:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:20.509373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d62f1-dd00-4455-a68d-173ecba66afb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:20.509879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d62f1-dd00-4455-a68d-173ecba66afb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:20.509975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d62f1-dd00-4455-a68d-173ecba66afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:20.530972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-583d62f1-dd00-4455-a68d-173ecba66afb None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:20.532184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1ad1-a2a3-45d6-b878-d29c82a8df5c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:20.532309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-583d62f1-dd00-4455-a68d-173ecba66afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:20.532623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1ad1-a2a3-45d6-b878-d29c82a8df5c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:20.532911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1ad1-a2a3-45d6-b878-d29c82a8df5c None None] PATH_INFO: `/v3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:20.534197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 758/1515] 10.222.0.36 () {54 vars in 929 bytes} [Mon Aug 1 17:01:20 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:01:20.540179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ec95b-e4b7-400e-aa4a-02386ea110bc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:20.540473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ec95b-e4b7-400e-aa4a-02386ea110bc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:20.540602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 758/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:20.540758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ec95b-e4b7-400e-aa4a-02386ea110bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:20.611850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1b6ec95b-e4b7-400e-aa4a-02386ea110bc None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:20.613071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1b6ec95b-e4b7-400e-aa4a-02386ea110bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:20.643307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:20.685888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 759/1517] 10.222.0.36 () {58 vars in 1019 bytes} [Mon Aug 1 17:01:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:01:20.692259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d62f1-dd00-4455-a68d-173ecba66afb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:20.705627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d62f1-dd00-4455-a68d-173ecba66afb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:20.711097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196190aa-8a13-4e19-865c-da5bba8714c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:20.711707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196190aa-8a13-4e19-865c-da5bba8714c3 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:20.711988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196190aa-8a13-4e19-865c-da5bba8714c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:20.712265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196190aa-8a13-4e19-865c-da5bba8714c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:20.721011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196190aa-8a13-4e19-865c-da5bba8714c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:20.722633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196190aa-8a13-4e19-865c-da5bba8714c3 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:20.731968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 759/1518] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:29.838196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9492e35-c4fd-47a9-862d-70eb74f5da5f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:29.838769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9492e35-c4fd-47a9-862d-70eb74f5da5f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:29.838769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9492e35-c4fd-47a9-862d-70eb74f5da5f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:29.840274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 760/1519] 10.222.0.121 () {54 vars in 966 bytes} [Mon Aug 1 17:01:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:29.845774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9e76-10f8-403f-8015-67fd6f6fc7a9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:29.846242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9e76-10f8-403f-8015-67fd6f6fc7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:29.846383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf9e76-10f8-403f-8015-67fd6f6fc7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:29.866006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5fcf9e76-10f8-403f-8015-67fd6f6fc7a9 None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:29.867284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5fcf9e76-10f8-403f-8015-67fd6f6fc7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:29.876932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 760/1520] 10.222.0.121 () {58 vars in 1063 bytes} [Mon Aug 1 17:01:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:29.884956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9492e35-c4fd-47a9-862d-70eb74f5da5f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:29.903818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9492e35-c4fd-47a9-862d-70eb74f5da5f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:29.908952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe1048-de2e-4750-ae51-0b08a0b82407 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:29.909581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1048-de2e-4750-ae51-0b08a0b82407 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:29.909870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1048-de2e-4750-ae51-0b08a0b82407 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:29.910154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe1048-de2e-4750-ae51-0b08a0b82407 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:29.922634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe1048-de2e-4750-ae51-0b08a0b82407 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:29.924263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe1048-de2e-4750-ae51-0b08a0b82407 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:29.933938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 761/1521] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:31.959618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b707a-f47c-49c4-8f97-4ed2c58b764c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:31.960178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b707a-f47c-49c4-8f97-4ed2c58b764c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:31.960178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b707a-f47c-49c4-8f97-4ed2c58b764c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:31.961538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 17:01:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:31.967041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4118-3573-499e-881c-7903a0d951e6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:31.967442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4118-3573-499e-881c-7903a0d951e6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:31.967626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4118-3573-499e-881c-7903a0d951e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:31.991052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fb3f4118-3573-499e-881c-7903a0d951e6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:31.992286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb3f4118-3573-499e-881c-7903a0d951e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:32.001821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 17:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:32.157592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b707a-f47c-49c4-8f97-4ed2c58b764c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:32.177898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b707a-f47c-49c4-8f97-4ed2c58b764c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:32.183618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee8ce1-4b5a-4c4b-beac-e2d59b0b99ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:32.184502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee8ce1-4b5a-4c4b-beac-e2d59b0b99ad service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:32.185154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee8ce1-4b5a-4c4b-beac-e2d59b0b99ad service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:32.185630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee8ce1-4b5a-4c4b-beac-e2d59b0b99ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:32.195027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee8ce1-4b5a-4c4b-beac-e2d59b0b99ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:32.196605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee8ce1-4b5a-4c4b-beac-e2d59b0b99ad service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:32.207414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 762/1524] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:33.027795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fc9b-e4b6-4616-be73-3791bed8c01b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:33.028607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fc9b-e4b6-4616-be73-3791bed8c01b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:33.028607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9fc9b-e4b6-4616-be73-3791bed8c01b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:33.031382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 17:01:33 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:33.038788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa89e1f-8397-44ad-a75a-7a47b45b7c9a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:33.039338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa89e1f-8397-44ad-a75a-7a47b45b7c9a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:33.039338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa89e1f-8397-44ad-a75a-7a47b45b7c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:33.061184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8aa89e1f-8397-44ad-a75a-7a47b45b7c9a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:33.062441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8aa89e1f-8397-44ad-a75a-7a47b45b7c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:33.074051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 17:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:33.227717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9fc9b-e4b6-4616-be73-3791bed8c01b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:33.242475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9fc9b-e4b6-4616-be73-3791bed8c01b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:33.248612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e029742-0f52-4625-a214-675ce53e6f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:33.249237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029742-0f52-4625-a214-675ce53e6f71 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:33.249522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029742-0f52-4625-a214-675ce53e6f71 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:33.249799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e029742-0f52-4625-a214-675ce53e6f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:33.258361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e029742-0f52-4625-a214-675ce53e6f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:33.260049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e029742-0f52-4625-a214-675ce53e6f71 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:33.270879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 764/1527] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:37.229644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a82f8e-75c8-410f-9a3e-0453188015a4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:37.230232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a82f8e-75c8-410f-9a3e-0453188015a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:37.230232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a82f8e-75c8-410f-9a3e-0453188015a4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:37.231608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 17:01:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:37.237327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fca59f-03bb-4ba1-abab-84522459cd45 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:37.237814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fca59f-03bb-4ba1-abab-84522459cd45 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:37.237922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fca59f-03bb-4ba1-abab-84522459cd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:37.259287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-53fca59f-03bb-4ba1-abab-84522459cd45 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:37.260515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53fca59f-03bb-4ba1-abab-84522459cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:37.269245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:37.348461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a82f8e-75c8-410f-9a3e-0453188015a4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:37.350473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c4a82f8e-75c8-410f-9a3e-0453188015a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:37.417966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:37.437709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a82f8e-75c8-410f-9a3e-0453188015a4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:37.441670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b6e28-da8e-4d10-b3df-085acb66ec8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:37.442350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6e28-da8e-4d10-b3df-085acb66ec8b service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:37.442637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6e28-da8e-4d10-b3df-085acb66ec8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:37.442917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b6e28-da8e-4d10-b3df-085acb66ec8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:37.452791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b6e28-da8e-4d10-b3df-085acb66ec8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:37.454301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b6e28-da8e-4d10-b3df-085acb66ec8b service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:37.464938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 765/1530] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:39.496118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66811e16-1b4d-4880-82de-2579ee0555cc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:39.496702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66811e16-1b4d-4880-82de-2579ee0555cc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:39.496702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66811e16-1b4d-4880-82de-2579ee0555cc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:39.498658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 17:01:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:39.505732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c406b-d6bf-4ba9-b098-5f8e7d7a20aa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:39.506247 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c406b-d6bf-4ba9-b098-5f8e7d7a20aa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:39.506662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c406b-d6bf-4ba9-b098-5f8e7d7a20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:39.528463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c67c406b-d6bf-4ba9-b098-5f8e7d7a20aa None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:39.529712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c67c406b-d6bf-4ba9-b098-5f8e7d7a20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:39.537915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 17:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:39.575381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66811e16-1b4d-4880-82de-2579ee0555cc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:39.578002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-66811e16-1b4d-4880-82de-2579ee0555cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:39.593333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66811e16-1b4d-4880-82de-2579ee0555cc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:39.597293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399c061-c7d0-4af5-a6cc-1858a0b3d15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:39.597922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c061-c7d0-4af5-a6cc-1858a0b3d15e service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:39.598209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c061-c7d0-4af5-a6cc-1858a0b3d15e service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:39.598517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c061-c7d0-4af5-a6cc-1858a0b3d15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:39.609316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399c061-c7d0-4af5-a6cc-1858a0b3d15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:39.610793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399c061-c7d0-4af5-a6cc-1858a0b3d15e service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:39.621007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 767/1533] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:43.223351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3195063-46f6-442a-8b0b-0913ef783876 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:43.223979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3195063-46f6-442a-8b0b-0913ef783876 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:43.223979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3195063-46f6-442a-8b0b-0913ef783876 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:43.225357 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 17:01:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:43.231624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cedb8-d10c-488d-807c-2590111ca32a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:43.232765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cedb8-d10c-488d-807c-2590111ca32a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:43.232870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cedb8-d10c-488d-807c-2590111ca32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:43.255182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-974cedb8-d10c-488d-807c-2590111ca32a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:43.256426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-974cedb8-d10c-488d-807c-2590111ca32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:43.264548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 17:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:01:43.660711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3195063-46f6-442a-8b0b-0913ef783876 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:43.662537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a3195063-46f6-442a-8b0b-0913ef783876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:43.744089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3195063-46f6-442a-8b0b-0913ef783876 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:43.748395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa51e2-efea-4dca-9897-4f79a33f4685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:43.749026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa51e2-efea-4dca-9897-4f79a33f4685 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:43.749314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa51e2-efea-4dca-9897-4f79a33f4685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:43.749600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa51e2-efea-4dca-9897-4f79a33f4685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:43.759275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa51e2-efea-4dca-9897-4f79a33f4685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:43.760711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa51e2-efea-4dca-9897-4f79a33f4685 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:43.770884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 768/1536] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:45.851151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f921-9557-4d18-86b1-7d4b151f4f3c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:45.851771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f921-9557-4d18-86b1-7d4b151f4f3c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:45.851771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f921-9557-4d18-86b1-7d4b151f4f3c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:45.853115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 17:01:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:01:45.859752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9ae9e-d869-41af-a44f-7817c4d3b8bf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:45.860455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9ae9e-d869-41af-a44f-7817c4d3b8bf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:45.860455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9ae9e-d869-41af-a44f-7817c4d3b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:45.882448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-11f9ae9e-d869-41af-a44f-7817c4d3b8bf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:01:45.883678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-11f9ae9e-d869-41af-a44f-7817c4d3b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:45.895371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 17:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:01:46.214642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839f921-9557-4d18-86b1-7d4b151f4f3c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:01:46.216396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a839f921-9557-4d18-86b1-7d4b151f4f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:01:46.230810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839f921-9557-4d18-86b1-7d4b151f4f3c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:01:46.234373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9559646-2136-4cb9-81cd-d40158d2d25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:01:46.234993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9559646-2136-4cb9-81cd-d40158d2d25b service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:01:46.235275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9559646-2136-4cb9-81cd-d40158d2d25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:01:46.235552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9559646-2136-4cb9-81cd-d40158d2d25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:01:46.244343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9559646-2136-4cb9-81cd-d40158d2d25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:01:46.246064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9559646-2136-4cb9-81cd-d40158d2d25b service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:01:46.256421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 770/1539] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:01:55.876644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=50 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:01:56.252110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=50 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:23.756582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80553-7466-41dc-8f10-f856855c78fa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.757536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80553-7466-41dc-8f10-f856855c78fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.757536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf80553-7466-41dc-8f10-f856855c78fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.780118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9bf80553-7466-41dc-8f10-f856855c78fa None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:23.781403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9bf80553-7466-41dc-8f10-f856855c78fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:23.790387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 770/1540] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:23.805380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52144-73c4-4503-a908-2651daabecd6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.806892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52144-73c4-4503-a908-2651daabecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.806892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52144-73c4-4503-a908-2651daabecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.834090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-47e52144-73c4-4503-a908-2651daabecd6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:23.835247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47e52144-73c4-4503-a908-2651daabecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:23.848768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 771/1541] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:23.853418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf80553-7466-41dc-8f10-f856855c78fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.875822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf80553-7466-41dc-8f10-f856855c78fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.888195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.890090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.890644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.891138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.892460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:23.893007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.894964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 17:03:23.894964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: warnings.warn(msg) Aug 01 17:03:23.894964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: Aug 01 17:03:23.896648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:23.927842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 771/1542] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:03:23.950553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52144-73c4-4503-a908-2651daabecd6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:23.971012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52144-73c4-4503-a908-2651daabecd6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:23.982396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:23.983146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:23.983623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:23.984100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:23.984841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:23.985881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 17:03:23.985881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 17:03:23.985881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 17:03:23.987158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.051658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 772/1543] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:23 2022] POST /identity/v3/projects => generated 384 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:24.056990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.079534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4f3d3-9b19-4763-8983-6b4cc3660cc9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.178162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.178840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.179129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.179412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.180210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.182168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 17:03:24.182168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: warnings.warn(msg) Aug 01 17:03:24.182168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: Aug 01 17:03:24.184170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.212831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 772/1544] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:24.217100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.228121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f62a40-e9a8-4aec-a38b-4910def7d8ab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.247934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.248609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.248888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.249166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.249886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.251643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.271276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 773/1545] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:24 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:24.275667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.287051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1feb5-f99c-4e9e-8279-d81150d55169 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.296477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2218-9196-409c-9a59-0eb50d53cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.297137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2218-9196-409c-9a59-0eb50d53cb1e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.297428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2218-9196-409c-9a59-0eb50d53cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.297715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2218-9196-409c-9a59-0eb50d53cb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.298459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f2218-9196-409c-9a59-0eb50d53cb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.300256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f2218-9196-409c-9a59-0eb50d53cb1e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.320428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 773/1546] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:24 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:24.326752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.341717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df68900-371d-4ea1-98a4-fc0bcda749fe admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.351214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1e341-9d4f-4670-8c9a-44180ce055a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.351937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1e341-9d4f-4670-8c9a-44180ce055a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.352216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1e341-9d4f-4670-8c9a-44180ce055a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.352520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1e341-9d4f-4670-8c9a-44180ce055a5 admin admin] PATH_INFO: `/v3/projects/6a8674db84704368b48aa26e694c9a49/users/cfc89f14ca4849a8ad694931204b6057/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.384731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1e341-9d4f-4670-8c9a-44180ce055a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8674db84704368b48aa26e694c9a49, user_id=cfc89f14ca4849a8ad694931204b6057, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.391199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-57e1e341-9d4f-4670-8c9a-44180ce055a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 17:03:24.391199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 17:03:24.391199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 17:03:24.395214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1e341-9d4f-4670-8c9a-44180ce055a5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.420867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 774/1547] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:24 2022] PUT /identity/v3/projects/6a8674db84704368b48aa26e694c9a49/users/cfc89f14ca4849a8ad694931204b6057/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:24.434895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ab95c-06e1-4ea0-872d-9223a8092431 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.435275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ab95c-06e1-4ea0-872d-9223a8092431 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.435467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ab95c-06e1-4ea0-872d-9223a8092431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.475116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4d7ab95c-06e1-4ea0-872d-9223a8092431 None None] MFA Rules not processed for user `cfc89f14ca4849a8ad694931204b6057`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.476397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4d7ab95c-06e1-4ea0-872d-9223a8092431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.496437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b5ab-c9d3-4d60-b05a-137ef69f30bd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.496793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b5ab-c9d3-4d60-b05a-137ef69f30bd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.496990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5b5ab-c9d3-4d60-b05a-137ef69f30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.535662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c9d5b5ab-c9d3-4d60-b05a-137ef69f30bd None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.536920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c9d5b5ab-c9d3-4d60-b05a-137ef69f30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.648445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 774/1548] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:24.678206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68df9-bf89-4fca-840b-4b2687375fc7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.683034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68df9-bf89-4fca-840b-4b2687375fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.683034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb68df9-bf89-4fca-840b-4b2687375fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.685334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 775/1549] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:24.695592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0ffff-dd7f-46e0-9d33-ae24277e7df4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.696251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0ffff-dd7f-46e0-9d33-ae24277e7df4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.696883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0ffff-dd7f-46e0-9d33-ae24277e7df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.757763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1ca0ffff-dd7f-46e0-9d33-ae24277e7df4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.759467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ca0ffff-dd7f-46e0-9d33-ae24277e7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.763507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fdb68df9-bf89-4fca-840b-4b2687375fc7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.763507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fdb68df9-bf89-4fca-840b-4b2687375fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.775089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 776/1550] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:24.776956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ba3f-fe47-4145-8cfc-aa9732081f70 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.777558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ba3f-fe47-4145-8cfc-aa9732081f70 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.778053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9ba3f-fe47-4145-8cfc-aa9732081f70 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.784885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 775/1551] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:24.786368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72e99-36ee-466b-9e4e-61396d987ebf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.786664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72e99-36ee-466b-9e4e-61396d987ebf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.789808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f72e99-36ee-466b-9e4e-61396d987ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.791240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 777/1552] 10.222.0.121 () {54 vars in 967 bytes} [Mon Aug 1 17:03:24 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:03:24.793492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e613e4-a218-4a1f-9656-56e27db93e70 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.794070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e613e4-a218-4a1f-9656-56e27db93e70 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.794598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e613e4-a218-4a1f-9656-56e27db93e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.848459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-59f72e99-36ee-466b-9e4e-61396d987ebf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.850616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-59f72e99-36ee-466b-9e4e-61396d987ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.880523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 776/1553] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:24.884992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f72e99-36ee-466b-9e4e-61396d987ebf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:24.888688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-03e613e4-a218-4a1f-9656-56e27db93e70 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.889520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-03e613e4-a218-4a1f-9656-56e27db93e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:24.920165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f72e99-36ee-466b-9e4e-61396d987ebf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:24.930486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6489db9-58cb-4732-8805-b88a36bde894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:24.930486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489db9-58cb-4732-8805-b88a36bde894 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.930486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489db9-58cb-4732-8805-b88a36bde894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.931217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489db9-58cb-4732-8805-b88a36bde894 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.932245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6489db9-58cb-4732-8805-b88a36bde894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:24.933691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6489db9-58cb-4732-8805-b88a36bde894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:24.937054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6489db9-58cb-4732-8805-b88a36bde894 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:24.961205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 777/1554] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:24.963167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6066-1994-472a-98f2-b149937fceed None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:24.963861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6066-1994-472a-98f2-b149937fceed None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:24.964330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6066-1994-472a-98f2-b149937fceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:24.994227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-871c6066-1994-472a-98f2-b149937fceed None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:24.996081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-871c6066-1994-472a-98f2-b149937fceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.005223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 778/1555] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.006542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cb038-7a7d-4026-aefa-13099fecde64 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.006882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cb038-7a7d-4026-aefa-13099fecde64 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.007891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cb038-7a7d-4026-aefa-13099fecde64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.016389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.031538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d62cb038-7a7d-4026-aefa-13099fecde64 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.033167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d62cb038-7a7d-4026-aefa-13099fecde64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.036322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 778/1556] 10.222.0.121 () {58 vars in 1064 bytes} [Mon Aug 1 17:03:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.037332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910fd70-69bb-4484-8e51-9e146a64c09f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.037747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910fd70-69bb-4484-8e51-9e146a64c09f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.037931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910fd70-69bb-4484-8e51-9e146a64c09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.043289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 779/1557] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.052912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4e03-b51b-4039-acd9-b96132ca0f68 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.053249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4e03-b51b-4039-acd9-b96132ca0f68 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.053478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4e03-b51b-4039-acd9-b96132ca0f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.065067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4910fd70-69bb-4484-8e51-9e146a64c09f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.066576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4910fd70-69bb-4484-8e51-9e146a64c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.075787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-de6d4e03-b51b-4039-acd9-b96132ca0f68 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.077012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-de6d4e03-b51b-4039-acd9-b96132ca0f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.081055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 779/1558] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.081893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910fd70-69bb-4484-8e51-9e146a64c09f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.089659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 780/1559] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.091049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0339a-57e6-4461-9e95-437e37917186 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.091391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0339a-57e6-4461-9e95-437e37917186 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.091695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0339a-57e6-4461-9e95-437e37917186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.103517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910fd70-69bb-4484-8e51-9e146a64c09f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.112230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86293-d4a8-4e30-a57e-c61d8bc0e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.113674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86293-d4a8-4e30-a57e-c61d8bc0e180 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.114184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86293-d4a8-4e30-a57e-c61d8bc0e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.114877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86293-d4a8-4e30-a57e-c61d8bc0e180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.115841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c86293-d4a8-4e30-a57e-c61d8bc0e180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.118039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c86293-d4a8-4e30-a57e-c61d8bc0e180 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.118708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.141302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-49a0339a-57e6-4461-9e95-437e37917186 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.142874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-49a0339a-57e6-4461-9e95-437e37917186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.166455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 781/1560] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.166455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0339a-57e6-4461-9e95-437e37917186 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.170683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0339a-57e6-4461-9e95-437e37917186 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.171612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 780/1561] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/projects => generated 384 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:25.173060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de042-6d82-43a3-993a-e4fee66ef165 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.173352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de042-6d82-43a3-993a-e4fee66ef165 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.173628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de042-6d82-43a3-993a-e4fee66ef165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.195058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2b6de042-6d82-43a3-993a-e4fee66ef165 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.196301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2b6de042-6d82-43a3-993a-e4fee66ef165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.251525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.252630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.253095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.253598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.255428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:25.256094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.259209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.275433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 782/1562] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:25.275666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.286024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 781/1563] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.286830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de042-6d82-43a3-993a-e4fee66ef165 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.299517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de042-6d82-43a3-993a-e4fee66ef165 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.304429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe44f6-c657-4e49-b1d5-a2ae0be292fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.305067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe44f6-c657-4e49-b1d5-a2ae0be292fb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.305352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe44f6-c657-4e49-b1d5-a2ae0be292fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.305632 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe44f6-c657-4e49-b1d5-a2ae0be292fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.306383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe44f6-c657-4e49-b1d5-a2ae0be292fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:25.306695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe44f6-c657-4e49-b1d5-a2ae0be292fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.308361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe44f6-c657-4e49-b1d5-a2ae0be292fb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.326022 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 782/1564] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:25.327390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a118-8887-41a6-9b7e-a06da06619c2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.327690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a118-8887-41a6-9b7e-a06da06619c2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.327971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a118-8887-41a6-9b7e-a06da06619c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.357670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5849a118-8887-41a6-9b7e-a06da06619c2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.359580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5849a118-8887-41a6-9b7e-a06da06619c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.369973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 783/1565] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.372025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d3d7-cd9e-4a42-85e1-1c24b8724fb6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.372322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d3d7-cd9e-4a42-85e1-1c24b8724fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.372601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d3d7-cd9e-4a42-85e1-1c24b8724fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.388898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50d01-5634-4125-8d74-3cffffc08f71 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.397114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.397854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0650d3d7-cd9e-4a42-85e1-1c24b8724fb6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.398036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.398297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.399014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.399383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0650d3d7-cd9e-4a42-85e1-1c24b8724fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.408389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 784/1566] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.409663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d3a0f-f5c7-46fe-8b0c-681677d5a179 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.409954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d3a0f-f5c7-46fe-8b0c-681677d5a179 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.410236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d3a0f-f5c7-46fe-8b0c-681677d5a179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.440276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e79d3a0f-f5c7-46fe-8b0c-681677d5a179 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.445861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e79d3a0f-f5c7-46fe-8b0c-681677d5a179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.461527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 785/1567] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.463162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d3a0f-f5c7-46fe-8b0c-681677d5a179 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.474035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.475422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d3a0f-f5c7-46fe-8b0c-681677d5a179 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.476217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.480923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.481707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.481819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.482874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.482874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.484833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.487831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 783/1568] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:25.488658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.500681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f15ca-aedf-47fd-b296-31f904dd5058 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.506573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.507373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.507674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.507944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.508618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.510783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.516378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 786/1569] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:25.520705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.531694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d559-1722-4085-b838-60cc07004889 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.536726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.537378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.537662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.538081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.538842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:25.539150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.540790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.549877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 784/1570] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/projects => generated 368 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:25.551351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.558305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 787/1571] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:25.565626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.566846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.579949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73028082-f23f-4fa3-92c1-9ff81dd72b21 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.649590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10751ddc-e167-4d85-b191-289bef3c1af5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.658118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.659068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.659518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.659796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.660468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.662740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.665794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee9ad2-90d4-4c7f-a68a-29fc981f47e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.667213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9ad2-90d4-4c7f-a68a-29fc981f47e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.667508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9ad2-90d4-4c7f-a68a-29fc981f47e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.667784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9ad2-90d4-4c7f-a68a-29fc981f47e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.668853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee9ad2-90d4-4c7f-a68a-29fc981f47e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:25.669221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee9ad2-90d4-4c7f-a68a-29fc981f47e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.671817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee9ad2-90d4-4c7f-a68a-29fc981f47e8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.688380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 788/1572] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:25.696725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9243-7adf-4c5f-b76f-d8bd0d792a65 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.696725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9243-7adf-4c5f-b76f-d8bd0d792a65 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.696725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9243-7adf-4c5f-b76f-d8bd0d792a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.701500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:25.712590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 785/1573] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/projects => generated 390 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:25.712590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.720396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b22d9243-7adf-4c5f-b76f-d8bd0d792a65 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:25.722655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b22d9243-7adf-4c5f-b76f-d8bd0d792a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:25.792910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3570-87e3-4c93-97d6-611f8616c5e8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.797764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.798428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.798713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.798989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.799691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:25.799996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.804007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 789/1574] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:25.804007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9243-7adf-4c5f-b76f-d8bd0d792a65 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.804291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.811464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9243-7adf-4c5f-b76f-d8bd0d792a65 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.816334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.816976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.817300 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.817623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.818431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.820068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.821152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 786/1575] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:25.829065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.831702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 790/1576] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:25.833377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.836312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5469-0ebd-48a8-8b55-c697f45735d6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.842537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.843170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.843456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.843733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.844406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.846408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.851770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e679b-180c-4b2e-9021-b81ac493f5a7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.858574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.859356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.859874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.860247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.861009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.863109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.874841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 787/1577] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/users => generated 285 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:25.875667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.895040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3e411-b617-4819-8ca5-1533dc6d59dd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:25.900442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345557-dfd7-4341-b54c-71c29a225934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:25.901592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345557-dfd7-4341-b54c-71c29a225934 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.901873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345557-dfd7-4341-b54c-71c29a225934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.902154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345557-dfd7-4341-b54c-71c29a225934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.902870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345557-dfd7-4341-b54c-71c29a225934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:25.904262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 791/1578] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/projects => generated 380 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:25.905196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345557-dfd7-4341-b54c-71c29a225934 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:25.905519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:25.940163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 788/1579] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/projects => generated 376 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:25.941502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d585-0618-4fda-b7f2-35404a776fa0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:25.941803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d585-0618-4fda-b7f2-35404a776fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:25.942063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845d585-0618-4fda-b7f2-35404a776fa0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:25.943370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 789/1580] 10.222.0.121 () {54 vars in 917 bytes} [Mon Aug 1 17:03:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:03:25.944068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845d585-0618-4fda-b7f2-35404a776fa0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.002381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.010838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baffc7b-4e13-4b1f-a561-6dc5309d4e68 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.027599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845d585-0618-4fda-b7f2-35404a776fa0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.034382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.035060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.035348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.035629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.036347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:26.036659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.038404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.051612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 790/1581] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:26.052867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.066907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a7c54-c7c9-48b4-aa61-60ac3ffe0fff admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.074009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.075140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.075329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.075728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.076872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.079038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.096067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.096948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.097228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.097506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.098189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.101164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.112820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 791/1582] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/projects => generated 394 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.114693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.131130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 792/1583] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:25 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.131994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.142433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b2e5c-183d-4ee4-b925-bfee9b7ebb12 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.146499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.198896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cac1a7-28b9-4217-bd36-ffcbb4d52b0a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.203977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.204606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.204893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.205171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.205885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.207556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.215966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.216601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.216881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.217423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.218315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.218492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 792/1584] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.219325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.221043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.233268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 793/1585] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.234393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.237340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d55206-8547-43c3-b949-8855ee6e68db admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.242628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae36238-e2af-44cf-be6c-9dc67d404aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.243266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36238-e2af-44cf-be6c-9dc67d404aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.243576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36238-e2af-44cf-be6c-9dc67d404aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.243825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae36238-e2af-44cf-be6c-9dc67d404aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.244504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae36238-e2af-44cf-be6c-9dc67d404aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.246405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce826a-e05a-4a26-8460-57578c66c090 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.246621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae36238-e2af-44cf-be6c-9dc67d404aa9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.252000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.252688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.252929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.253256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.254356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.256591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.285946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 793/1586] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/users => generated 291 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.285946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812baab1-cd0d-47cf-a6cc-848f382796bd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.285946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812baab1-cd0d-47cf-a6cc-848f382796bd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.285946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812baab1-cd0d-47cf-a6cc-848f382796bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.291690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 794/1587] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.293255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.307981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d074c8-ab28-4221-ac20-a7d7f576d6ac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.311125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-812baab1-cd0d-47cf-a6cc-848f382796bd None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:26.312489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-812baab1-cd0d-47cf-a6cc-848f382796bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.314619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.315773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.316160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.316540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.317317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.320460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.362223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 795/1588] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/projects => generated 374 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.362223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.398323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 794/1589] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:26.403155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812baab1-cd0d-47cf-a6cc-848f382796bd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.416155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812baab1-cd0d-47cf-a6cc-848f382796bd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.440543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7100aea-b6ee-4391-87e9-47958f3830e4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.444932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.447019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.448852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.449302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.449704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.450495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.452473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.477164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 796/1590] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.478200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.489203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0db69-3d1a-4e4e-8824-f00557ab320f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.494253 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.495534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.495902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.496194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] PATH_INFO: `/v3/projects/6e61adb9cb4948cd95dbbc6b707a6bd4/users/b125e48efd9c4907be550b3f4077134c/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.500796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.501485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.501899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.502202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.503101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.504683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.515375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e61adb9cb4948cd95dbbc6b707a6bd4, user_id=b125e48efd9c4907be550b3f4077134c, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.518187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.519323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 795/1591] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.520731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.534210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 797/1592] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:26 2022] PUT /identity/v3/projects/6e61adb9cb4948cd95dbbc6b707a6bd4/users/b125e48efd9c4907be550b3f4077134c/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:26.538144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14028c-e2e5-4592-8106-bad4c9fc28ef admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.539279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.572682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:26.613707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba17a8-b651-4ddf-a2b0-1530fde96d06 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.618497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.619158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.620525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.621040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.622134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.624162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.630397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.631059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.631341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.631631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.632530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.634484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 798/1593] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.634605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.635450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.646617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d6a60-28dd-4fd9-b55a-68525a8806a6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.649035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 796/1594] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.649986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.653179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.654291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.654559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.654835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.655548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.657205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.662580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc45cd-4112-40d9-a0d0-1eca2b35890d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.671069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.672010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 799/1595] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.672173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.672516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.672952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.673415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.674097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.676182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.713482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 797/1596] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:26.713482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.722574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a9630-3592-4fed-8977-bdff2860dae8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.727782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.728416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.728709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.729012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.729822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.731497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.743076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 798/1597] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.743954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.756448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609655-662a-43f7-8754-058caf5b6239 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.761652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd84aab-714b-4b2a-b6e0-62b425be5b02 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.765055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908adc-d5c2-4e44-9de4-b2eaa7d1bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.766598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908adc-d5c2-4e44-9de4-b2eaa7d1bc4c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.767371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.767985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908adc-d5c2-4e44-9de4-b2eaa7d1bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.767985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908adc-d5c2-4e44-9de4-b2eaa7d1bc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.768513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.768513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.769043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908adc-d5c2-4e44-9de4-b2eaa7d1bc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.769298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.770604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908adc-d5c2-4e44-9de4-b2eaa7d1bc4c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.785258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 799/1598] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.786627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930c93-af1f-4f05-b55e-832212b461cf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.786917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930c93-af1f-4f05-b55e-832212b461cf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.787194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b930c93-af1f-4f05-b55e-832212b461cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.808045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8b930c93-af1f-4f05-b55e-832212b461cf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:26.808737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8b930c93-af1f-4f05-b55e-832212b461cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:26.819492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 800/1599] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:26.824871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930c93-af1f-4f05-b55e-832212b461cf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.840024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b930c93-af1f-4f05-b55e-832212b461cf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.849145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.850561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.851243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.852199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.853472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.856152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.868737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 801/1600] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.868737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.869091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.871702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.879102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1117-5a7b-4e6d-b17b-0e34a4d66b9a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.883864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.884534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.884815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.885097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] PATH_INFO: `/v3/projects/12d83af7b5624e5c984d19d6e70deaec/users/6cc210196fcf4b0296df5a19a7176415/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.887906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 800/1601] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:26.888004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.904290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d83af7b5624e5c984d19d6e70deaec, user_id=6cc210196fcf4b0296df5a19a7176415, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.907206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.913415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff09f6-26e8-436d-9d1b-7d9a80914742 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.920320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:26.920965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:26.921249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:26.921533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:26.922232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:26.923887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:26.926102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 802/1602] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:26 2022] PUT /identity/v3/projects/12d83af7b5624e5c984d19d6e70deaec/users/6cc210196fcf4b0296df5a19a7176415/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:26.927053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.938292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 801/1603] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:26.938292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:26.956002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7a0e5-0007-4720-9a2e-e3d9e9051e35 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:26.992520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.015147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.024876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3546c3-4a2f-40ba-a7e9-b099d6a19d5d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.036702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.037358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.037650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.037928 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.038679 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.039879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.040317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.040678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.041053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.041405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.042765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.044546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.056322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 803/1604] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:27.056322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.058079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 802/1605] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:26 2022] GET /identity/v3/roles => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:27.063820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.065668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd6d3-fb4c-46da-b886-420f7f9d4d10 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.072471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.073651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.074007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.074390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] PATH_INFO: `/v3/projects/32994118a4204798a11263b254c41b55/users/cc1712f30dcc4ff4b350c91c76f5a3f3/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.093345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32994118a4204798a11263b254c41b55, user_id=cc1712f30dcc4ff4b350c91c76f5a3f3, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.096200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.118189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 804/1606] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:27 2022] PUT /identity/v3/projects/32994118a4204798a11263b254c41b55/users/cc1712f30dcc4ff4b350c91c76f5a3f3/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.125768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.143648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4df33e-4575-4fb5-9059-a1faee4044ee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.209964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988045a-884c-40b7-9cc7-ca05a73199e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.211043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988045a-884c-40b7-9cc7-ca05a73199e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.211527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988045a-884c-40b7-9cc7-ca05a73199e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.211812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988045a-884c-40b7-9cc7-ca05a73199e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.232408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa3dcf-49fd-4df2-a57e-3064a8e01c0c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.238374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.239161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.239466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.239744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] PATH_INFO: `/v3/projects/ca3d02d4abc749858513bcb8a75ff3cd/users/78c65d4466174c9bb8c931af6befd6c2/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.257027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3d02d4abc749858513bcb8a75ff3cd, user_id=78c65d4466174c9bb8c931af6befd6c2, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.261536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.285405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 805/1607] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:27 2022] PUT /identity/v3/projects/ca3d02d4abc749858513bcb8a75ff3cd/users/78c65d4466174c9bb8c931af6befd6c2/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.287559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.317159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988045a-884c-40b7-9cc7-ca05a73199e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.318642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988045a-884c-40b7-9cc7-ca05a73199e1 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.329816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 803/1608] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:27.331262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69206-0cb4-45d2-8b2c-35f34cbe11f6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.331577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69206-0cb4-45d2-8b2c-35f34cbe11f6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.331810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e69206-0cb4-45d2-8b2c-35f34cbe11f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.367019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f9e69206-0cb4-45d2-8b2c-35f34cbe11f6 None None] MFA Rules not processed for user `6cc210196fcf4b0296df5a19a7176415`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:27.369168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f9e69206-0cb4-45d2-8b2c-35f34cbe11f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.373881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549410d-c53e-464d-85c7-c22785c6377f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.380938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.381938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.382392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.382746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] PATH_INFO: `/v3/projects/fca0b67ab14c4d78a56a5cd9695dc693/users/e6779c1c95ee4cdebbee060460dad5d6/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.400906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca0b67ab14c4d78a56a5cd9695dc693, user_id=e6779c1c95ee4cdebbee060460dad5d6, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.404020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.428690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 806/1609] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:27 2022] PUT /identity/v3/projects/fca0b67ab14c4d78a56a5cd9695dc693/users/e6779c1c95ee4cdebbee060460dad5d6/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.429821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.433202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.463910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.493727 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 804/1610] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:27.495422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69206-0cb4-45d2-8b2c-35f34cbe11f6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.509578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e69206-0cb4-45d2-8b2c-35f34cbe11f6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.546390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dbc61-ba6c-47a8-9b69-814741f8dc36 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.556300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e961-aa39-4a72-916b-56a5223c175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.557800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e961-aa39-4a72-916b-56a5223c175d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.558834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e961-aa39-4a72-916b-56a5223c175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.559372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e961-aa39-4a72-916b-56a5223c175d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.560455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e961-aa39-4a72-916b-56a5223c175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.563502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e961-aa39-4a72-916b-56a5223c175d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.585085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 807/1611] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/roles => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:27.585085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79044-45c1-475f-b1a2-19cbe9227a7f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.585945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79044-45c1-475f-b1a2-19cbe9227a7f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.586464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79044-45c1-475f-b1a2-19cbe9227a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.623697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-04d79044-45c1-475f-b1a2-19cbe9227a7f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:27.625141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-04d79044-45c1-475f-b1a2-19cbe9227a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.627986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb68bf-95da-4937-80ae-2156994a476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.628684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb68bf-95da-4937-80ae-2156994a476a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.628967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb68bf-95da-4937-80ae-2156994a476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.629485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb68bf-95da-4937-80ae-2156994a476a admin admin] PATH_INFO: `/v3/projects/56f3f870120a4e5d92b73c363a3de04e/users/5c607e35877c4872a448c9a5e8a8a29c/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.639174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 808/1612] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:27.639174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3c5b8-2c91-4b97-b529-1bcd3ad37799 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.639174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3c5b8-2c91-4b97-b529-1bcd3ad37799 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.639174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3c5b8-2c91-4b97-b529-1bcd3ad37799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.654520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb68bf-95da-4937-80ae-2156994a476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f3f870120a4e5d92b73c363a3de04e, user_id=5c607e35877c4872a448c9a5e8a8a29c, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.657988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb68bf-95da-4937-80ae-2156994a476a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.669800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2cb3c5b8-2c91-4b97-b529-1bcd3ad37799 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:27.671005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2cb3c5b8-2c91-4b97-b529-1bcd3ad37799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.676599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 805/1613] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:27 2022] PUT /identity/v3/projects/56f3f870120a4e5d92b73c363a3de04e/users/5c607e35877c4872a448c9a5e8a8a29c/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.678893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68baf-0daa-4f6f-9153-b9cf1059e818 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.679745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68baf-0daa-4f6f-9153-b9cf1059e818 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.680279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68baf-0daa-4f6f-9153-b9cf1059e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.717024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cab68baf-0daa-4f6f-9153-b9cf1059e818 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:27.718714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cab68baf-0daa-4f6f-9153-b9cf1059e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:27.767693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 809/1614] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:27.767693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3c5b8-2c91-4b97-b529-1bcd3ad37799 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.803503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 806/1615] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:27.803503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68baf-0daa-4f6f-9153-b9cf1059e818 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.817147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68baf-0daa-4f6f-9153-b9cf1059e818 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:27.823038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:27.823755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:27.824048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:27.824458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] PATH_INFO: `/v3/projects/28f25934887a4b2f9080e8d323d7a3c8/users/4d2839271b9f43ff969af017a3e41898/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:27.845410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f25934887a4b2f9080e8d323d7a3c8, user_id=4d2839271b9f43ff969af017a3e41898, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:27.849566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:27.873242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 807/1616] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:27 2022] PUT /identity/v3/projects/28f25934887a4b2f9080e8d323d7a3c8/users/4d2839271b9f43ff969af017a3e41898/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:27.874416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:27.965192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:27.993897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3c5b8-2c91-4b97-b529-1bcd3ad37799 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.001609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92d92-7ae9-4896-98be-a2a5db6f939f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.014442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5910c0-6653-4d11-aae2-9d8d3315ffbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.015043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5910c0-6653-4d11-aae2-9d8d3315ffbc service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.015331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5910c0-6653-4d11-aae2-9d8d3315ffbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.015616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5910c0-6653-4d11-aae2-9d8d3315ffbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.131861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.133531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.133865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.135850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.163217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:28.189535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5910c0-6653-4d11-aae2-9d8d3315ffbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.197093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5910c0-6653-4d11-aae2-9d8d3315ffbc service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.223431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.225214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.230072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 808/1617] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.235209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e7d9-3153-483a-af1a-4ed90823082d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.239719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e7d9-3153-483a-af1a-4ed90823082d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.240001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e7d9-3153-483a-af1a-4ed90823082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.240344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 810/1618] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.255387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.287356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24795af-50f6-459a-9e60-a3b37465dfb3 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.289423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4426e7d9-3153-483a-af1a-4ed90823082d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:28.290708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4426e7d9-3153-483a-af1a-4ed90823082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:28.308003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.308718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.309008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.309293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.315221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 809/1619] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:28.316616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c1a1-84f0-43a1-adc6-e0af9d9cdd05 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.316914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c1a1-84f0-43a1-adc6-e0af9d9cdd05 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.317197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c1a1-84f0-43a1-adc6-e0af9d9cdd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.339929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.341465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.376979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 811/1620] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.378876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.379987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6bf9c1a1-84f0-43a1-adc6-e0af9d9cdd05 None None] MFA Rules not processed for user `4d2839271b9f43ff969af017a3e41898`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:28.382050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6bf9c1a1-84f0-43a1-adc6-e0af9d9cdd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:28.396665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a127-58ad-463b-a618-60f232bfb4a4 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.404611 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa326328-3eb6-4e74-b1c8-f6c3492962e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.406387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa326328-3eb6-4e74-b1c8-f6c3492962e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.406615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa326328-3eb6-4e74-b1c8-f6c3492962e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.407052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa326328-3eb6-4e74-b1c8-f6c3492962e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.420348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa326328-3eb6-4e74-b1c8-f6c3492962e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.422622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa326328-3eb6-4e74-b1c8-f6c3492962e7 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.442889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 812/1621] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.444573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f440-2342-4a2d-91f2-62ac82b2dff0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.444962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f440-2342-4a2d-91f2-62ac82b2dff0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.445339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f440-2342-4a2d-91f2-62ac82b2dff0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.447564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 813/1622] 10.222.0.121 () {54 vars in 967 bytes} [Mon Aug 1 17:03:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:03:28.449985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319f440-2342-4a2d-91f2-62ac82b2dff0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.476926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319f440-2342-4a2d-91f2-62ac82b2dff0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.485192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.486584 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.487024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.487316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.499330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 810/1623] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:28.500930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88872-e35f-4865-8f2b-0db38d592218 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.501224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88872-e35f-4865-8f2b-0db38d592218 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.501502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88872-e35f-4865-8f2b-0db38d592218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.515256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.516732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.543986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 814/1624] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.545440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.557778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-12d88872-e35f-4865-8f2b-0db38d592218 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:28.562290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-12d88872-e35f-4865-8f2b-0db38d592218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:28.685081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:28.707639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 811/1625] 10.222.0.121 () {58 vars in 1064 bytes} [Mon Aug 1 17:03:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:28.722862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7ff1-6840-493c-9be9-f34c35cef499 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.723202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7ff1-6840-493c-9be9-f34c35cef499 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.723574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7ff1-6840-493c-9be9-f34c35cef499 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.727510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 812/1626] 10.222.0.121 () {54 vars in 917 bytes} [Mon Aug 1 17:03:28 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:03:28.739298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c71a-c7dd-41a8-a4fd-0e39ddc99d50 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.739519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c71a-c7dd-41a8-a4fd-0e39ddc99d50 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.740117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c71a-c7dd-41a8-a4fd-0e39ddc99d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.743443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba57cd-774f-4ac7-b5dc-fa491bec1d2f service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.772316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.772675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.773154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.773449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.789962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.792395 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:28.808257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 815/1627] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:28.820092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9d65c71a-c7dd-41a8-a4fd-0e39ddc99d50 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:28.822046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9d65c71a-c7dd-41a8-a4fd-0e39ddc99d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:28.855117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 813/1628] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:03:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:28.877238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65c71a-c7dd-41a8-a4fd-0e39ddc99d50 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:28.902705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65c71a-c7dd-41a8-a4fd-0e39ddc99d50 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:28.920261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:28.920939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:28.923045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:28.923360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:28.962217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:28.967908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:29.027149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 814/1629] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:32.911637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:32.924636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e66c5-892f-4c63-9db9-52979c426866 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:32.936081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:32.939904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:32.942748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:32.944241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] PATH_INFO: `/v3/users/cfc89f14ca4849a8ad694931204b6057` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:32.946647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc89f14ca4849a8ad694931204b6057)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:32.950315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.043485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.053403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc89f14ca4849a8ad694931204b6057'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.059555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1006c4-2860-4ce0-a760-61bdfb76b164 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.062538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc89f14ca4849a8ad694931204b6057'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.065914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:33.072083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.073484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.073773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.074135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] PATH_INFO: `/v3/users/4d2839271b9f43ff969af017a3e41898` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.075559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2839271b9f43ff969af017a3e41898)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.077267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 17:03:33.077267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: warnings.warn(msg) Aug 01 17:03:33.077267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: Aug 01 17:03:33.078891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.099181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc89f14ca4849a8ad694931204b6057'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.100006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc89f14ca4849a8ad694931204b6057'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.100894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b701cee8-9acc-4c6f-84a6-ceee37779251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc89f14ca4849a8ad694931204b6057'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.132309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 816/1630] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:32 2022] DELETE /identity/v3/users/cfc89f14ca4849a8ad694931204b6057 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:33.144621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.145044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.146431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.205935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:33.211824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:33.231791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2839271b9f43ff969af017a3e41898'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.261389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2839271b9f43ff969af017a3e41898'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.264510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2839271b9f43ff969af017a3e41898'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.264510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2839271b9f43ff969af017a3e41898'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.291288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3d60a97a-e470-4625-bd2d-c8c895bbc3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2839271b9f43ff969af017a3e41898'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:33.343460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 815/1631] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:33 2022] DELETE /identity/v3/users/4d2839271b9f43ff969af017a3e41898 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:33.348042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.348667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.349096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.358285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 817/1632] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:33.376865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:33.378707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:33.392978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.394710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:33.476337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fedb3-19d4-4f80-acd2-4a8b51030635 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.536460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 816/1633] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:33.570098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.570778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.571115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.571397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.584180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.585323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:33.585822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.589083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:33.599555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 818/1634] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:33.617889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf441-27d2-4e9d-a9d9-85abd777abe4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:33.627334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d2716-7b4b-4454-813e-793708da14a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:33.627992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d2716-7b4b-4454-813e-793708da14a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:33.628276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d2716-7b4b-4454-813e-793708da14a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:33.628553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d2716-7b4b-4454-813e-793708da14a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:33.640888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d2716-7b4b-4454-813e-793708da14a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:33.644972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d2716-7b4b-4454-813e-793708da14a8 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:33.668484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 817/1635] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:36.155975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:36.157975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:36.177068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894312-58a9-409c-9727-52b37c9de57d service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:36.202109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:36.202645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:36.202935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:36.203224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] PATH_INFO: `/v3/projects/28f25934887a4b2f9080e8d323d7a3c8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:36.205956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f25934887a4b2f9080e8d323d7a3c8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:36.206738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 17:03:36.206738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: warnings.warn(msg) Aug 01 17:03:36.206738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: Aug 01 17:03:36.208404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:36.300316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:36.363608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f25934887a4b2f9080e8d323d7a3c8', 'request_id': 'req-bbcadc53-c72a-4b71-8de5-2709a9403244'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:36.395638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f25934887a4b2f9080e8d323d7a3c8', 'request_id': 'req-bbcadc53-c72a-4b71-8de5-2709a9403244'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:36.422177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f25934887a4b2f9080e8d323d7a3c8', 'request_id': 'req-bbcadc53-c72a-4b71-8de5-2709a9403244'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:36.462599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] The token cache is being invalidate because project 28f25934887a4b2f9080e8d323d7a3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:36.464158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:36.465459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bbcadc53-c72a-4b71-8de5-2709a9403244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:36.474365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 819/1636] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:36 2022] DELETE /identity/v3/projects/28f25934887a4b2f9080e8d323d7a3c8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:36.482454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:36.483914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:36.484340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:36.546762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:36.555544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:36.708871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:36.835330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 818/1637] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:36.839115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a4ea-9c11-450d-b235-53b156bc8bd7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:36.841253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a4ea-9c11-450d-b235-53b156bc8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:36.841646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3a4ea-9c11-450d-b235-53b156bc8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:36.897315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:36.899055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:36.903353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fbf3a4ea-9c11-450d-b235-53b156bc8bd7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:36.906683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fbf3a4ea-9c11-450d-b235-53b156bc8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:36.926442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea854070-19e9-4488-beac-fe3f9380563c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:36.952689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 820/1638] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:36.954104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3a4ea-9c11-450d-b235-53b156bc8bd7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:36.968270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:36.969123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:36.970744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:36.970744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] PATH_INFO: `/v3/projects/6a8674db84704368b48aa26e694c9a49` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:36.971874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8674db84704368b48aa26e694c9a49)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:36.977977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.017626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3a4ea-9c11-450d-b235-53b156bc8bd7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.046598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.048248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.049468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.050436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.054918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:37.055260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.084154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.121216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 821/1639] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:37.126125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.161459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfaae-429f-4f15-8b5c-8fe8098eadd1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.189465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.190186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.190528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.193812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.194652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.201455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.243955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8674db84704368b48aa26e694c9a49', 'request_id': 'req-52f19a1a-a390-4278-9c6b-31820fe8b869'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:37.273575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 822/1640] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:37 2022] POST /identity/v3/projects => generated 364 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:37.276306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.283405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8674db84704368b48aa26e694c9a49', 'request_id': 'req-52f19a1a-a390-4278-9c6b-31820fe8b869'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:37.320198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8674db84704368b48aa26e694c9a49', 'request_id': 'req-52f19a1a-a390-4278-9c6b-31820fe8b869'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:37.341874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] The token cache is being invalidate because project 6a8674db84704368b48aa26e694c9a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:37.344351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:37.350673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52f19a1a-a390-4278-9c6b-31820fe8b869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:37.358394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 819/1641] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:36 2022] DELETE /identity/v3/projects/6a8674db84704368b48aa26e694c9a49 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:37.366666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9462c4b-02d0-49c6-8fb9-db930598c490 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.368748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9462c4b-02d0-49c6-8fb9-db930598c490 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.372046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9462c4b-02d0-49c6-8fb9-db930598c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.452693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b9462c4b-02d0-49c6-8fb9-db930598c490 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:37.455019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351efc3-08d3-4032-9dfa-ac276758e5b1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.456517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9462c4b-02d0-49c6-8fb9-db930598c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:37.473073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.473728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.474015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.474313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.475011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.477303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.494552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 820/1642] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:37.503152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf942c-7963-4b84-8365-7e65d0279dac None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.504161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf942c-7963-4b84-8365-7e65d0279dac None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.504649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf942c-7963-4b84-8365-7e65d0279dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.546065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 823/1643] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:37 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:37.552882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.556233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:37.575834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f9bf942c-7963-4b84-8365-7e65d0279dac None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:37.578917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f9bf942c-7963-4b84-8365-7e65d0279dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:37.595118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78c4e-8c94-4162-96d8-6667034d7ad9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.605147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.605771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 821/1644] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:37.606143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.606640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.607096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.608149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.609524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf942c-7963-4b84-8365-7e65d0279dac None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.610245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.625351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf942c-7963-4b84-8365-7e65d0279dac None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.633504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.634538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.635724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.636247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.639936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 824/1645] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:37 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:37.642598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.642895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:37.643397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.646628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.666234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a515c4-b1da-4c5c-9610-b570004ebb9a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.673666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 822/1646] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:37.678578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.680477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.681146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.681412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.682738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.682994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.690253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.709821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f909-4b1c-4a8b-83bc-7a902568462f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.720965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 825/1647] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:37 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:37.722169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.724877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.725528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.725811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.726286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.727058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.731540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.753095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cccbab-0523-466f-95f0-2c41f8a0be30 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.762922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f054268-f4c5-4fad-8020-4db2f76f4520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:37.763965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054268-f4c5-4fad-8020-4db2f76f4520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.764256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054268-f4c5-4fad-8020-4db2f76f4520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.765671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054268-f4c5-4fad-8020-4db2f76f4520 admin admin] PATH_INFO: `/v3/projects/d23d8c1147994652b22dac3cbc051cd5/users/0a108eab526c472c8fd8f2bd0a31e408/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.801561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 823/1648] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:37 2022] POST /identity/v3/projects => generated 358 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:37.805313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:37.806675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f054268-f4c5-4fad-8020-4db2f76f4520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23d8c1147994652b22dac3cbc051cd5, user_id=0a108eab526c472c8fd8f2bd0a31e408, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:37.810235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f054268-f4c5-4fad-8020-4db2f76f4520 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:37.862545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 826/1649] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:37 2022] PUT /identity/v3/projects/d23d8c1147994652b22dac3cbc051cd5/users/0a108eab526c472c8fd8f2bd0a31e408/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:37.864652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94dd6-a68d-4711-9064-7264e440bcee None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:37.864954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94dd6-a68d-4711-9064-7264e440bcee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:37.865245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94dd6-a68d-4711-9064-7264e440bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:37.935645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93209-c4cd-41f6-b556-94158e5252a8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:37.947920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dab94dd6-a68d-4711-9064-7264e440bcee None None] MFA Rules not processed for user `0a108eab526c472c8fd8f2bd0a31e408`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:37.948380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dab94dd6-a68d-4711-9064-7264e440bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:37.968855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:37.973807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:38.036819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.038495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.038878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.039236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.040497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.044257 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.084945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 824/1650] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:37 2022] POST /identity/v3/users => generated 280 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:38.091820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.124429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 827/1651] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:38.125055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d8f9-1bd2-4500-9fd6-7016ed8d4d27 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.128534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94dd6-a68d-4711-9064-7264e440bcee None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.142991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.143744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.144093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.144441 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.145231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.147204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.161414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94dd6-a68d-4711-9064-7264e440bcee None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.171252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.173532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.175135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.175833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.176725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.183126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 825/1652] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:38 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:38.183796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.186659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.211091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1de8d-85b0-438f-b9ce-0632b3c5f543 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.230014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.230744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.231151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.231500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.232273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.235488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.261976 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 828/1653] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:38 2022] POST /identity/v3/projects => generated 364 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:38.267570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.290664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 826/1654] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:38 2022] GET /identity/v3/roles => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:03:38.296564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.329821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56d61b-495d-4488-bb81-0b4453fd4bac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.411158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a09d15-6883-46a6-b19e-f8cea5071821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.411860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09d15-6883-46a6-b19e-f8cea5071821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.412145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09d15-6883-46a6-b19e-f8cea5071821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.412896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09d15-6883-46a6-b19e-f8cea5071821 admin admin] PATH_INFO: `/v3/projects/33efd17965ee48d0bf9e8c1903b544ff/users/c20a0999591b442a93bfa13a5736c37d/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.450337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09d15-6883-46a6-b19e-f8cea5071821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33efd17965ee48d0bf9e8c1903b544ff, user_id=c20a0999591b442a93bfa13a5736c37d, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.453433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09d15-6883-46a6-b19e-f8cea5071821 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.461033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8ef1b-c7d7-4ffe-93b7-ba83429a6197 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.471753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 827/1655] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:38 2022] PUT /identity/v3/projects/33efd17965ee48d0bf9e8c1903b544ff/users/c20a0999591b442a93bfa13a5736c37d/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:38.490882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd613e34-22ce-4307-800b-7f647120ef19 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.492915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd613e34-22ce-4307-800b-7f647120ef19 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.495532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd613e34-22ce-4307-800b-7f647120ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.641670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cd613e34-22ce-4307-800b-7f647120ef19 None None] MFA Rules not processed for user `c20a0999591b442a93bfa13a5736c37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:38.656903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cd613e34-22ce-4307-800b-7f647120ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:38.687466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.688364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.688821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.697278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.698311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.702516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.770120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 829/1656] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:38 2022] POST /identity/v3/users => generated 289 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:38.773527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.833244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fac291-1cfb-4010-a2ba-d7bb0e899768 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.855443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.856558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.857404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.857851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.858754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.866133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.884766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 828/1657] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:38.887967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd613e34-22ce-4307-800b-7f647120ef19 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.898728 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:38.923373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 830/1658] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:38 2022] GET /identity/v3/roles => generated 1427 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:38.926421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:38.927058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd613e34-22ce-4307-800b-7f647120ef19 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.951358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.952148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.952509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.952861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:38.953671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:38.959367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed3df-fe4b-4a77-b6da-4add5e43b3d6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:38.968082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:38.980733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:38.981791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:38.982276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:38.982943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] PATH_INFO: `/v3/projects/2173d39780504acba717b7da1adcb191/users/712afd95ec8d4555838562149d21097c/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.008690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:39.028836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173d39780504acba717b7da1adcb191, user_id=712afd95ec8d4555838562149d21097c, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:39.037135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:39.064315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 829/1659] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:38 2022] POST /identity/v3/projects => generated 358 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:39.069315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.078099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 831/1660] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:38 2022] PUT /identity/v3/projects/2173d39780504acba717b7da1adcb191/users/712afd95ec8d4555838562149d21097c/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:39.083098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.237842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107197f1-e9d4-4f52-83f8-d40c2ed07bb0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:39.263209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:39.264501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.264823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.265989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.266908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:39.271883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:39.306867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfb16f-c65b-4440-aff9-ef900b0c90a8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:39.315162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 832/1661] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:39 2022] GET /identity/v3/roles => generated 1427 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:39.316494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.332233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:39.332592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.332884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.333167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.333852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:39.337421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6951ed-55ca-44cc-b86e-a367bc241403 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:39.343287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:39.345082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c7136-4571-421a-bcb1-ab839e17baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:39.346525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c7136-4571-421a-bcb1-ab839e17baee admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.346955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c7136-4571-421a-bcb1-ab839e17baee admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.347389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c7136-4571-421a-bcb1-ab839e17baee admin admin] PATH_INFO: `/v3/projects/2173d39780504acba717b7da1adcb191/users/712afd95ec8d4555838562149d21097c/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.357169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c7136-4571-421a-bcb1-ab839e17baee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173d39780504acba717b7da1adcb191, user_id=712afd95ec8d4555838562149d21097c, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:39.363230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c7136-4571-421a-bcb1-ab839e17baee admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:39.376755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 833/1662] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:39 2022] PUT /identity/v3/projects/2173d39780504acba717b7da1adcb191/users/712afd95ec8d4555838562149d21097c/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:39.390125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df37b-f8a4-431c-97c6-49cffef45f4c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.390860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df37b-f8a4-431c-97c6-49cffef45f4c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.390860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64df37b-f8a4-431c-97c6-49cffef45f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.422385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 830/1663] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:39 2022] POST /identity/v3/users => generated 286 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:39.426142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.447608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a23c2-505c-44a7-9819-6ebb539170c9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:39.492993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d64df37b-f8a4-431c-97c6-49cffef45f4c None None] MFA Rules not processed for user `712afd95ec8d4555838562149d21097c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:39.494605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d64df37b-f8a4-431c-97c6-49cffef45f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:39.640187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:39.643631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.644002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.644290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.646857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:39.648602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:39.677445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 831/1664] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:39 2022] GET /identity/v3/roles => generated 1427 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:39.678750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.680961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:39.684185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 834/1665] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:39.684918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64df37b-f8a4-431c-97c6-49cffef45f4c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.715332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64df37b-f8a4-431c-97c6-49cffef45f4c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:39.721073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:39.721770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.722054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.722351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] PATH_INFO: `/v3/projects/793d50e9d6b749edb64bf33652d9640a/users/707f290a19db43c1a235ddf5e23b6511/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.742342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdce83-1810-449a-b9e9-bef8045c12c5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:39.757955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=793d50e9d6b749edb64bf33652d9640a, user_id=707f290a19db43c1a235ddf5e23b6511, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:39.762379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:39.762515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:39.764353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.764647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.765090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] PATH_INFO: `/v3/users/6cc210196fcf4b0296df5a19a7176415` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.768798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc210196fcf4b0296df5a19a7176415)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:39.774121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:39.788179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 835/1666] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:39 2022] PUT /identity/v3/projects/793d50e9d6b749edb64bf33652d9640a/users/707f290a19db43c1a235ddf5e23b6511/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:39.792736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.806400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:39.884761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc210196fcf4b0296df5a19a7176415'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:39.896120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:39.903273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc210196fcf4b0296df5a19a7176415'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:39.906308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc210196fcf4b0296df5a19a7176415'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:39.907216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc210196fcf4b0296df5a19a7176415'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:39.914932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:39.936508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc210196fcf4b0296df5a19a7176415'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:39.943314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fc4fe-1d37-4a89-ba58-e8ea39368fec admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:39.954299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b5da7-0248-4348-9d54-b82e23efd57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:39.955498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b5da7-0248-4348-9d54-b82e23efd57a service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:39.955958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b5da7-0248-4348-9d54-b82e23efd57a service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:39.956452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b5da7-0248-4348-9d54-b82e23efd57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:39.959836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5e4b5da7-0248-4348-9d54-b82e23efd57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:39.971722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 832/1667] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:39 2022] DELETE /identity/v3/users/6cc210196fcf4b0296df5a19a7176415 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:39.974698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:39.977995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.051217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b5da7-0248-4348-9d54-b82e23efd57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.052805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b5da7-0248-4348-9d54-b82e23efd57a service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.080348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 836/1668] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:40.084764 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201f0e-8e2a-4abd-9095-01cce5bb70a4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.087773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201f0e-8e2a-4abd-9095-01cce5bb70a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.089139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201f0e-8e2a-4abd-9095-01cce5bb70a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.130613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192b327-9fb6-4123-b9d4-bae4539283e4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.139751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d7201f0e-8e2a-4abd-9095-01cce5bb70a4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:40.143602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d7201f0e-8e2a-4abd-9095-01cce5bb70a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.145358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:40.146016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.146321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.146611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.147344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.149223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.167088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 837/1669] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:40.177659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 833/1670] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:39 2022] GET /identity/v3/roles => generated 1427 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:40.177855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201f0e-8e2a-4abd-9095-01cce5bb70a4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:40.199357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:40.202174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.215772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201f0e-8e2a-4abd-9095-01cce5bb70a4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.237809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ba506-5796-4bde-a7d9-2e0a97f40473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:40.239158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba506-5796-4bde-a7d9-2e0a97f40473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.239698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba506-5796-4bde-a7d9-2e0a97f40473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.239698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba506-5796-4bde-a7d9-2e0a97f40473 admin admin] PATH_INFO: `/v3/projects/793d50e9d6b749edb64bf33652d9640a/users/707f290a19db43c1a235ddf5e23b6511/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.247519 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ba506-5796-4bde-a7d9-2e0a97f40473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793d50e9d6b749edb64bf33652d9640a, user_id=707f290a19db43c1a235ddf5e23b6511, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.256333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ba506-5796-4bde-a7d9-2e0a97f40473 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.284122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 838/1671] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:40 2022] PUT /identity/v3/projects/793d50e9d6b749edb64bf33652d9640a/users/707f290a19db43c1a235ddf5e23b6511/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:40.295949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.297098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.297536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.345225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc8620-8c9e-4d83-87b6-063f33e2e9ac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.375890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] MFA Rules not processed for user `707f290a19db43c1a235ddf5e23b6511`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:40.389983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.477464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:40.478286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.479369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.479752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.551084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:40.586494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.593624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.632925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 839/1672] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:40.644748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 834/1673] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:40.653288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:40.654836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:40.768506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:40.774871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da78fde-6ba6-405f-a588-0d20d44ac4c6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:40.787046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab447-6d3c-4004-b043-fb92be798469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:40.787636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab447-6d3c-4004-b043-fb92be798469 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:40.787927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab447-6d3c-4004-b043-fb92be798469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:40.788213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab447-6d3c-4004-b043-fb92be798469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:40.810340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab447-6d3c-4004-b043-fb92be798469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:40.811762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab447-6d3c-4004-b043-fb92be798469 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:40.832020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 840/1674] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:40.996160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.018464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5de9f7-fe40-4384-a6f2-8a922aeb6962 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.018464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.018991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.019301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.019574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.025168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.175528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.176998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.181722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed08c-9249-4bd6-b56e-c9b1a0b50408 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.182614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed08c-9249-4bd6-b56e-c9b1a0b50408 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.182936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed08c-9249-4bd6-b56e-c9b1a0b50408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.200507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 835/1675] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:41.221433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.223326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.245074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b10e-2827-4ddd-a91c-eb23a204d357 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.250498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.250675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-59eed08c-9249-4bd6-b56e-c9b1a0b50408 None None] MFA Rules not processed for user `b125e48efd9c4907be550b3f4077134c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:41.251235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.251450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.251729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] PATH_INFO: `/v3/users/0a108eab526c472c8fd8f2bd0a31e408` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.252137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-59eed08c-9249-4bd6-b56e-c9b1a0b50408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.253284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a108eab526c472c8fd8f2bd0a31e408)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.255609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.365654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a108eab526c472c8fd8f2bd0a31e408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.376077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a108eab526c472c8fd8f2bd0a31e408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.377222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a108eab526c472c8fd8f2bd0a31e408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.377921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a108eab526c472c8fd8f2bd0a31e408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.398436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a108eab526c472c8fd8f2bd0a31e408'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:41.441903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 836/1676] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:41 2022] DELETE /identity/v3/users/0a108eab526c472c8fd8f2bd0a31e408 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:03:41.444504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 841/1677] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:41.451889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.452195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.452482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.457666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.460036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.487490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:41.488740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.651751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 842/1678] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:41.660660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:41.694012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76b150-8eb7-4133-9eaf-a0e1503fb92b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.703559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.705372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.705864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.706440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.724345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:41.725926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:41.806362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.808258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.836930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 837/1679] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:41.886828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dcf66-a1de-42ae-a4aa-ff6223a2c534 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:41.899394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd03a0-0a0b-4f24-aebc-2abd62bf398e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:41.900068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd03a0-0a0b-4f24-aebc-2abd62bf398e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:41.901366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd03a0-0a0b-4f24-aebc-2abd62bf398e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:41.901659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd03a0-0a0b-4f24-aebc-2abd62bf398e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:41.935909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd03a0-0a0b-4f24-aebc-2abd62bf398e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:41.937407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd03a0-0a0b-4f24-aebc-2abd62bf398e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:41.967008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 843/1680] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:42.324530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.326226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.352061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08ca68-43ba-4557-8edc-069db2e9985b service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.361514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.362244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.362645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.362933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] PATH_INFO: `/v3/projects/12d83af7b5624e5c984d19d6e70deaec` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.365449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d83af7b5624e5c984d19d6e70deaec)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.372212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.470067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d83af7b5624e5c984d19d6e70deaec', 'request_id': 'req-27f8251f-9ff7-4430-919a-4828cbd7948d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.486611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d83af7b5624e5c984d19d6e70deaec', 'request_id': 'req-27f8251f-9ff7-4430-919a-4828cbd7948d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.509134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d83af7b5624e5c984d19d6e70deaec', 'request_id': 'req-27f8251f-9ff7-4430-919a-4828cbd7948d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.530681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] The token cache is being invalidate because project 12d83af7b5624e5c984d19d6e70deaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:42.530991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.532004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-27f8251f-9ff7-4430-919a-4828cbd7948d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:42.538565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 838/1681] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:42 2022] DELETE /identity/v3/projects/12d83af7b5624e5c984d19d6e70deaec => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:42.540323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d687d-5696-41de-9d11-0e8ae78263fa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.540837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d687d-5696-41de-9d11-0e8ae78263fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.541149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d687d-5696-41de-9d11-0e8ae78263fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.581945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f49d687d-5696-41de-9d11-0e8ae78263fa None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:42.583278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f49d687d-5696-41de-9d11-0e8ae78263fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.634922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:42.746479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 844/1682] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:42.756820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa0f4-32c0-40ec-b454-ec9a28e7116c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.757220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa0f4-32c0-40ec-b454-ec9a28e7116c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.757220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa0f4-32c0-40ec-b454-ec9a28e7116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.811685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-718aa0f4-32c0-40ec-b454-ec9a28e7116c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:42.813111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-718aa0f4-32c0-40ec-b454-ec9a28e7116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:42.850326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 839/1683] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:42.851818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d687d-5696-41de-9d11-0e8ae78263fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.904081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d687d-5696-41de-9d11-0e8ae78263fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.915202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.915861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.916148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.916968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.917687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:42.917997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.920785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:42.940039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 845/1684] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:42.944324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa0f4-32c0-40ec-b454-ec9a28e7116c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:42.965211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa0f4-32c0-40ec-b454-ec9a28e7116c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:42.973101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:42.973761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:42.974107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:42.974447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:42.975177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:42.980866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.030433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 840/1685] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:42 2022] POST /identity/v3/projects => generated 368 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:43.038669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.066691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b85b-e51c-4c87-994b-83d17a8ba38e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.259335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.260728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.261061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.261349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.262056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.264125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.303199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 846/1686] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:43 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:43.305419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.334690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259308e-b0d1-47f2-b51e-6a11d1e23551 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.346742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.347448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.347741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.348290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.349787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.352793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.385605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 841/1687] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:43 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:43.391137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.410422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd06371-7993-48de-8c1c-c9b9e601b16b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.428306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b9e7d-4d5b-4f82-bbc9-c8caf182e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.429128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e7d-4d5b-4f82-bbc9-c8caf182e5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.429531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e7d-4d5b-4f82-bbc9-c8caf182e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.429958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b9e7d-4d5b-4f82-bbc9-c8caf182e5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.430873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9e7d-4d5b-4f82-bbc9-c8caf182e5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.432748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b9e7d-4d5b-4f82-bbc9-c8caf182e5d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.466998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 847/1688] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:43 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:43.471069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.487530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6dd84-0adc-4e3a-ba93-4ac36204e890 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:43.507613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:43.508332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.508620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.508904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] PATH_INFO: `/v3/projects/9b70a8fa9d7b4b83b8e5d738a6fa93c7/users/3a4f68a8dd7b4bc388ca1a5b3e1faf8e/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.574087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b70a8fa9d7b4b83b8e5d738a6fa93c7, user_id=3a4f68a8dd7b4bc388ca1a5b3e1faf8e, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:43.582381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:43.640765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 842/1689] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:43 2022] PUT /identity/v3/projects/9b70a8fa9d7b4b83b8e5d738a6fa93c7/users/3a4f68a8dd7b4bc388ca1a5b3e1faf8e/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:43.654421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1031-74c8-4536-831e-beb29a36b6d3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:43.655264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1031-74c8-4536-831e-beb29a36b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:43.655687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1031-74c8-4536-831e-beb29a36b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:43.720547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8e4f1031-74c8-4536-831e-beb29a36b6d3 None None] MFA Rules not processed for user `3a4f68a8dd7b4bc388ca1a5b3e1faf8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:43.722225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8e4f1031-74c8-4536-831e-beb29a36b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:43.923479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 848/1690] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:43.928143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:43.938211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:44.063690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95235f-a8d3-4923-a013-3a25bf7d17f9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.069356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.070018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.070333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.070616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.071524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.073946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.136286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 843/1691] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:43 2022] POST /identity/v3/projects => generated 370 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:44.140378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1031-74c8-4536-831e-beb29a36b6d3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.160742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1031-74c8-4536-831e-beb29a36b6d3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.211920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:44.333718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.334335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.334630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.334914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.335670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.337662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.402289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 849/1692] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:44 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:44.406387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.431209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070d4d-7907-4361-ab71-bd9452a52838 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.454182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.455003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.455294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.455573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.457164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.461113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.509144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 844/1693] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:44 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:44.511472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.528719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1d1eb-a12a-4dd2-8f5f-9fa0afbbee80 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.542520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.544817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.545426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.546834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] PATH_INFO: `/v3/projects/a358c6156cc34d15b0dc1493d30990d1/users/a08255297ad8474fb53015c6d79ebcb1/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.596113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a358c6156cc34d15b0dc1493d30990d1, user_id=a08255297ad8474fb53015c6d79ebcb1, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.611152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.652193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 850/1694] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:44 2022] PUT /identity/v3/projects/a358c6156cc34d15b0dc1493d30990d1/users/a08255297ad8474fb53015c6d79ebcb1/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:44.656889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.684879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e3477-966a-4f84-a73e-2ccfed3ed310 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.862595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa01568-d255-4ff0-8653-59839b83b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.863403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa01568-d255-4ff0-8653-59839b83b205 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.863924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa01568-d255-4ff0-8653-59839b83b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.864334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa01568-d255-4ff0-8653-59839b83b205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.865523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa01568-d255-4ff0-8653-59839b83b205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.867236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa01568-d255-4ff0-8653-59839b83b205 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.906545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 845/1695] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:44 2022] GET /identity/v3/roles => generated 1427 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:44.912761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:44.929002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00711d71-fe5d-4a6a-bade-7727da97d439 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:44.942500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:44.943280 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.943577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.943974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] PATH_INFO: `/v3/projects/a358c6156cc34d15b0dc1493d30990d1/users/a08255297ad8474fb53015c6d79ebcb1/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:44.949545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a358c6156cc34d15b0dc1493d30990d1, user_id=a08255297ad8474fb53015c6d79ebcb1, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:44.956918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:44.984797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 851/1696] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:44 2022] PUT /identity/v3/projects/a358c6156cc34d15b0dc1493d30990d1/users/a08255297ad8474fb53015c6d79ebcb1/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:44.995548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:44.996097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:44.996097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.080711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] MFA Rules not processed for user `a08255297ad8474fb53015c6d79ebcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:45.084817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.206830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.211424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.318456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 846/1697] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:45.336913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.339414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.346646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:45.476416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d27c7-28ef-4be6-8342-3dda77ff9969 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.491224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.493571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.496172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.499180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] PATH_INFO: `/v3/projects/d23d8c1147994652b22dac3cbc051cd5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.501322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23d8c1147994652b22dac3cbc051cd5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.508210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.548713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120799c-0a16-4331-bc2d-1d4a6684ee42 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.558350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a0380-e547-47dc-a022-25a31183ec11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.559335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a0380-e547-47dc-a022-25a31183ec11 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.559813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a0380-e547-47dc-a022-25a31183ec11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.559987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a0380-e547-47dc-a022-25a31183ec11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.576932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a0380-e547-47dc-a022-25a31183ec11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.579486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a0380-e547-47dc-a022-25a31183ec11 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.610651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 847/1698] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:45.612864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de74ba-542d-4fde-b8a8-4f6ecf2e33f9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.613149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de74ba-542d-4fde-b8a8-4f6ecf2e33f9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.613431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de74ba-542d-4fde-b8a8-4f6ecf2e33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.647628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23d8c1147994652b22dac3cbc051cd5', 'request_id': 'req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.659902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23d8c1147994652b22dac3cbc051cd5', 'request_id': 'req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.684488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23d8c1147994652b22dac3cbc051cd5', 'request_id': 'req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.702862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:45.709607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-04de74ba-542d-4fde-b8a8-4f6ecf2e33f9 None None] MFA Rules not processed for user `5c607e35877c4872a448c9a5e8a8a29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:45.711392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04de74ba-542d-4fde-b8a8-4f6ecf2e33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.715096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] The token cache is being invalidate because project d23d8c1147994652b22dac3cbc051cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:45.715390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.719856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:45.727206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 852/1699] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:45 2022] DELETE /identity/v3/projects/d23d8c1147994652b22dac3cbc051cd5 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:45.734846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:45.739660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:45.907056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 848/1700] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:45.918973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.918973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.918973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.938361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b26310-a0c9-43e2-bfd2-a99e0675c0ee admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:45.969368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:45.970224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:45.970545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:45.970829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] PATH_INFO: `/v3/users/712afd95ec8d4555838562149d21097c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:45.972364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=712afd95ec8d4555838562149d21097c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:45.974377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:45.987116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] MFA Rules not processed for user `5c607e35877c4872a448c9a5e8a8a29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:45.987116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:46.013762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 849/1701] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:46.027105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:46.029507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:46.127204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712afd95ec8d4555838562149d21097c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:46.156633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712afd95ec8d4555838562149d21097c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:46.204671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712afd95ec8d4555838562149d21097c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:46.207879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712afd95ec8d4555838562149d21097c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:46.214793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712afd95ec8d4555838562149d21097c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:46.254060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 853/1702] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:45 2022] DELETE /identity/v3/users/712afd95ec8d4555838562149d21097c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:46.290424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491f00a-1751-4fac-8eeb-1b324b67fa64 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:46.344983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:46.437429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc5d30-153e-45cc-9589-75147c3dc166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:46.438084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc5d30-153e-45cc-9589-75147c3dc166 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:46.438398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc5d30-153e-45cc-9589-75147c3dc166 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:46.438699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc5d30-153e-45cc-9589-75147c3dc166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:46.446325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eefc5d30-153e-45cc-9589-75147c3dc166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:46.578002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc5d30-153e-45cc-9589-75147c3dc166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:46.581963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc5d30-153e-45cc-9589-75147c3dc166 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:46.610907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 850/1703] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:47.494296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:47.497251 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:47.644609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b08e7-a0fd-43ca-a65a-6e48ed7fa88a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:47.661919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:47.662706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:47.663197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:47.663761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] PATH_INFO: `/v3/projects/2173d39780504acba717b7da1adcb191` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:47.668120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2173d39780504acba717b7da1adcb191)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:47.673632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:47.726121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:47.801766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2173d39780504acba717b7da1adcb191', 'request_id': 'req-6c4c9c4b-bc28-417b-b628-c64eca97547b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:47.814738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:47.815747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:47.816194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:47.828565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2173d39780504acba717b7da1adcb191', 'request_id': 'req-6c4c9c4b-bc28-417b-b628-c64eca97547b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:47.863310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2173d39780504acba717b7da1adcb191', 'request_id': 'req-6c4c9c4b-bc28-417b-b628-c64eca97547b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:47.895097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] The token cache is being invalidate because project 2173d39780504acba717b7da1adcb191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:47.895656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:47.906594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6c4c9c4b-bc28-417b-b628-c64eca97547b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:47.909098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 854/1704] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:47 2022] DELETE /identity/v3/projects/2173d39780504acba717b7da1adcb191 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:47.910932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] MFA Rules not processed for user `cc1712f30dcc4ff4b350c91c76f5a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:47.915653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eb0df-8808-4bae-ac13-8a8715c23eb0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:47.917122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eb0df-8808-4bae-ac13-8a8715c23eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:47.917887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:47.918049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eb0df-8808-4bae-ac13-8a8715c23eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:47.974497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-521eb0df-8808-4bae-ac13-8a8715c23eb0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:47.978233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-521eb0df-8808-4bae-ac13-8a8715c23eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.133251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 851/1705] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:48.146406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.148243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.186012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 855/1706] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:48.195084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727389b-92aa-4f00-bf06-3fbf8bef12ac None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.195376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727389b-92aa-4f00-bf06-3fbf8bef12ac None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.195683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727389b-92aa-4f00-bf06-3fbf8bef12ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.253674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f727389b-92aa-4f00-bf06-3fbf8bef12ac None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:48.254744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f727389b-92aa-4f00-bf06-3fbf8bef12ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.299189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 856/1707] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:48.300859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727389b-92aa-4f00-bf06-3fbf8bef12ac None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.332895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:48.342935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727389b-92aa-4f00-bf06-3fbf8bef12ac None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.366942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100046e-0026-41d0-842f-ca854bcff0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.367596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100046e-0026-41d0-842f-ca854bcff0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.369046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100046e-0026-41d0-842f-ca854bcff0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.369469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100046e-0026-41d0-842f-ca854bcff0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.373590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100046e-0026-41d0-842f-ca854bcff0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:48.373925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100046e-0026-41d0-842f-ca854bcff0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.380893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100046e-0026-41d0-842f-ca854bcff0c0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.421548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 857/1708] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:48.422615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772805fa-48b0-47a5-aedf-15f0cc081200 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.423429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7df92-f1ba-4133-b201-5d3dc8d0da50 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.423882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7df92-f1ba-4133-b201-5d3dc8d0da50 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.424349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7df92-f1ba-4133-b201-5d3dc8d0da50 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.426297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 858/1709] 10.222.0.121 () {54 vars in 917 bytes} [Mon Aug 1 17:03:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:03:48.431095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7df92-f1ba-4133-b201-5d3dc8d0da50 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.452048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.452629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7df92-f1ba-4133-b201-5d3dc8d0da50 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.452738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.452978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.453254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.459505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270210f-9e64-46c7-9d94-9e6895a67024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.460697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270210f-9e64-46c7-9d94-9e6895a67024 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.461192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270210f-9e64-46c7-9d94-9e6895a67024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.461721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270210f-9e64-46c7-9d94-9e6895a67024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.462775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270210f-9e64-46c7-9d94-9e6895a67024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.465525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270210f-9e64-46c7-9d94-9e6895a67024 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.483186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.484903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.508958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 859/1710] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:48 2022] POST /identity/v3/projects => generated 378 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:48.511327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 852/1711] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:48.513128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.528564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43d5d8-60bc-46d2-be80-996f4e034eb5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.529533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43d5d8-60bc-46d2-be80-996f4e034eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.530052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43d5d8-60bc-46d2-be80-996f4e034eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.545942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3d60-e9a8-49d1-b2ac-7e8a0bb5d567 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.646658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd43d5d8-60bc-46d2-be80-996f4e034eb5 None None] MFA Rules not processed for user `112c65065f6d4c5990f3952e0099cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:48.649083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd43d5d8-60bc-46d2-be80-996f4e034eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.684346 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.684994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.685284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.685558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.686247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.701989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.748747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 860/1712] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:48.750301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 853/1713] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:48 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:48.754937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43d5d8-60bc-46d2-be80-996f4e034eb5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.766993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:48.772852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43d5d8-60bc-46d2-be80-996f4e034eb5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.779793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12899fe-5fbe-4d61-8db6-b45004b7cfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.782091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12899fe-5fbe-4d61-8db6-b45004b7cfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.782557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12899fe-5fbe-4d61-8db6-b45004b7cfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.782896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12899fe-5fbe-4d61-8db6-b45004b7cfd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.783693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12899fe-5fbe-4d61-8db6-b45004b7cfd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.786146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12899fe-5fbe-4d61-8db6-b45004b7cfd8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.820197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 861/1714] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:48 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:48.820897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.837190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbd96c-063c-4a05-aa8a-ede1ace048a2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.853539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.854434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.854889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.855153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.855463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.855813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.856198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.857890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.859878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:48.888503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 854/1715] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:48 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:48.891986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:48.894405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] MFA Rules not processed for user `b125e48efd9c4907be550b3f4077134c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:48.896638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:48.917083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71712690-1db2-4bc7-bc94-ab14b3fcfa42 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:48.931432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64515f9-1fd9-4f75-a137-9a4d3b509a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:48.932777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64515f9-1fd9-4f75-a137-9a4d3b509a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:48.933291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64515f9-1fd9-4f75-a137-9a4d3b509a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:48.933741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64515f9-1fd9-4f75-a137-9a4d3b509a73 admin admin] PATH_INFO: `/v3/projects/f0832c0179e945ddbeee2f75535459dd/users/0963bb74acee4d4bb30856b9e19962d8/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:48.982702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64515f9-1fd9-4f75-a137-9a4d3b509a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0832c0179e945ddbeee2f75535459dd, user_id=0963bb74acee4d4bb30856b9e19962d8, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:48.985943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64515f9-1fd9-4f75-a137-9a4d3b509a73 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:49.011418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 855/1716] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:48 2022] PUT /identity/v3/projects/f0832c0179e945ddbeee2f75535459dd/users/0963bb74acee4d4bb30856b9e19962d8/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:49.024994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a7302-1690-46cf-b0b0-69da1ada9763 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:49.025294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a7302-1690-46cf-b0b0-69da1ada9763 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:49.025610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a7302-1690-46cf-b0b0-69da1ada9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:49.086205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 862/1717] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:49.124919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:49.126013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:49.154883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d67026-b26f-408f-9991-1ef5192e11ee None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:49.195601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e37a7302-1690-46cf-b0b0-69da1ada9763 None None] MFA Rules not processed for user `0963bb74acee4d4bb30856b9e19962d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:49.197177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e37a7302-1690-46cf-b0b0-69da1ada9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:49.319262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:49.321300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:49.321300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:49.321300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:49.348587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:49.350849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:49.362783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 863/1718] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:49.363696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:49.366011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:49.405214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 856/1719] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:49.412385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03894c6-005e-4dde-8844-194af8301003 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:49.412678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03894c6-005e-4dde-8844-194af8301003 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:49.417435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03894c6-005e-4dde-8844-194af8301003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:49.461204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b4948-0d9d-4d9f-ab33-2c0e80aaafd3 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:49.466230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:49.467012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:49.468129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:49.468129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] PATH_INFO: `/v3/users/3a4f68a8dd7b4bc388ca1a5b3e1faf8e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:49.469210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4f68a8dd7b4bc388ca1a5b3e1faf8e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:49.471304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:49.483729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c03894c6-005e-4dde-8844-194af8301003 None None] MFA Rules not processed for user `78c65d4466174c9bb8c931af6befd6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:49.506412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c03894c6-005e-4dde-8844-194af8301003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:49.530861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:49.564533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:49.575189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4f68a8dd7b4bc388ca1a5b3e1faf8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:49.591355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4f68a8dd7b4bc388ca1a5b3e1faf8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:49.618819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4f68a8dd7b4bc388ca1a5b3e1faf8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:49.621138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4f68a8dd7b4bc388ca1a5b3e1faf8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:49.622680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4f68a8dd7b4bc388ca1a5b3e1faf8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:49.659690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 864/1720] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:49 2022] DELETE /identity/v3/users/3a4f68a8dd7b4bc388ca1a5b3e1faf8e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:49.660659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:49.664900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:49.690927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 857/1721] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:49.694819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a3786-8845-4fb5-93a4-a96ab9353525 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:49.695210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a3786-8845-4fb5-93a4-a96ab9353525 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:49.696268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a3786-8845-4fb5-93a4-a96ab9353525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:49.737958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-275a3786-8845-4fb5-93a4-a96ab9353525 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:49.742461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-275a3786-8845-4fb5-93a4-a96ab9353525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:49.818355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0e18b-0c46-478c-be02-8029183b2e74 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:49.827077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904de609-9c9b-43f1-a91a-c262a525fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:49.827934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de609-9c9b-43f1-a91a-c262a525fb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:49.828233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de609-9c9b-43f1-a91a-c262a525fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:49.828517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de609-9c9b-43f1-a91a-c262a525fb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:49.829215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904de609-9c9b-43f1-a91a-c262a525fb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:49.831459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904de609-9c9b-43f1-a91a-c262a525fb1b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:49.922867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 865/1722] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:49 2022] POST /identity/v3/projects => generated 376 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:49.924301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:49.924605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:49.924892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:49.962355 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 858/1723] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:49.965489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a3786-8845-4fb5-93a4-a96ab9353525 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:49.988023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] MFA Rules not processed for user `78c65d4466174c9bb8c931af6befd6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:49.990809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:49.992187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a3786-8845-4fb5-93a4-a96ab9353525 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:50.141411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 866/1724] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:50.146810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:50.152837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:50.198936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fa2db-faa5-40e2-b860-7e961ae1a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:50.199936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa2db-faa5-40e2-b860-7e961ae1a775 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:50.200510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa2db-faa5-40e2-b860-7e961ae1a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:50.202694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa2db-faa5-40e2-b860-7e961ae1a775 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:50.203580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fa2db-faa5-40e2-b860-7e961ae1a775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:50.211237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fa2db-faa5-40e2-b860-7e961ae1a775 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:50.315231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 859/1725] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:49 2022] POST /identity/v3/users => generated 295 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:50.324293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0828-eee7-47d0-9de5-2929864c5743 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:50.327870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0828-eee7-47d0-9de5-2929864c5743 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:50.329533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0828-eee7-47d0-9de5-2929864c5743 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:50.338734 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 860/1726] 10.222.0.121 () {54 vars in 917 bytes} [Mon Aug 1 17:03:50 2022] GET /identity => generated 271 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:03:50.340534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0828-eee7-47d0-9de5-2929864c5743 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:50.364103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a9406-1640-41e8-a4d5-8c55798d3447 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:50.380940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:50.382140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d0828-eee7-47d0-9de5-2929864c5743 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:50.386213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:50.386540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:50.387723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:50.397172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e6c0e-a903-4f35-be60-5531da2d3751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:50.397823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e6c0e-a903-4f35-be60-5531da2d3751 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:50.398108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e6c0e-a903-4f35-be60-5531da2d3751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:50.398445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e6c0e-a903-4f35-be60-5531da2d3751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:50.399752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e6c0e-a903-4f35-be60-5531da2d3751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:50.404743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e6c0e-a903-4f35-be60-5531da2d3751 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:50.416452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:50.423930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:50.425464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:50.445987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 861/1727] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:50 2022] GET /identity/v3/roles => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:50.464981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:50.465189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:50.465343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:50.470220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 867/1728] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:50.471117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:50.501392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc7fc8-1b95-47bd-b005-1952b35122ca service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:50.509783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:50.529478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:50.530624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:50.532645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] PATH_INFO: `/v3/projects/e6aac27851954c18bc01cfc2d2ce99c3/users/84db604547a54b5e94d5295ee1d70fdf/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:50.546085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] MFA Rules not processed for user `112c65065f6d4c5990f3952e0099cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:50.564286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:50.616513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6aac27851954c18bc01cfc2d2ce99c3, user_id=84db604547a54b5e94d5295ee1d70fdf, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:50.619915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:50.624946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 862/1729] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:03:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:50.626750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:50.630721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:50.665228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 868/1730] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:50 2022] PUT /identity/v3/projects/e6aac27851954c18bc01cfc2d2ce99c3/users/84db604547a54b5e94d5295ee1d70fdf/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:50.665228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:50.677477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:50.738118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:50.920206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8e007-b094-406a-b5d4-31ec5dce2b69 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:50.940168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:50.940838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:50.946476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:50.946857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:50.965304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30365ab1-eff1-435f-a796-66fac7a2604a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:50.969184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:50.972973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:50.997794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 869/1731] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:51.015175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:51.189422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc2fc2-286d-4dde-8271-4e9ad7798e2d service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:51.202495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5b7e5-ae39-40d9-84ff-2f747b2a3611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:51.205389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b7e5-ae39-40d9-84ff-2f747b2a3611 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:51.205915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b7e5-ae39-40d9-84ff-2f747b2a3611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:51.206496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b7e5-ae39-40d9-84ff-2f747b2a3611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:51.209805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5b7e5-ae39-40d9-84ff-2f747b2a3611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:51.213424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846095-b04c-4ba5-852b-7e68b4df9a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:51.214091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846095-b04c-4ba5-852b-7e68b4df9a83 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:51.214415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846095-b04c-4ba5-852b-7e68b4df9a83 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:51.214697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846095-b04c-4ba5-852b-7e68b4df9a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:51.215006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5b7e5-ae39-40d9-84ff-2f747b2a3611 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:51.252057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 870/1732] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:50 2022] GET /identity/v3/roles => generated 1427 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:51.254136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c824-ad2c-431c-bc97-a42f08add407 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:51.254655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c824-ad2c-431c-bc97-a42f08add407 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:51.255390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c824-ad2c-431c-bc97-a42f08add407 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:51.259489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 871/1733] 10.222.0.121 () {54 vars in 966 bytes} [Mon Aug 1 17:03:51 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:03:51.298462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9c824-ad2c-431c-bc97-a42f08add407 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:51.350679 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9c824-ad2c-431c-bc97-a42f08add407 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:51.364510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38452b-24d7-417d-9283-eac9bd5b2ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:51.365442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38452b-24d7-417d-9283-eac9bd5b2ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:51.365826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38452b-24d7-417d-9283-eac9bd5b2ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:51.366203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38452b-24d7-417d-9283-eac9bd5b2ef8 admin admin] PATH_INFO: `/v3/projects/e6aac27851954c18bc01cfc2d2ce99c3/users/84db604547a54b5e94d5295ee1d70fdf/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:51.374007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38452b-24d7-417d-9283-eac9bd5b2ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6aac27851954c18bc01cfc2d2ce99c3, user_id=84db604547a54b5e94d5295ee1d70fdf, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:51.377219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38452b-24d7-417d-9283-eac9bd5b2ef8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:51.406563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 872/1734] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:51 2022] PUT /identity/v3/projects/e6aac27851954c18bc01cfc2d2ce99c3/users/84db604547a54b5e94d5295ee1d70fdf/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:51.407894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25269c-dd02-4c99-ac5a-d10da90084b6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:51.408189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25269c-dd02-4c99-ac5a-d10da90084b6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:51.408471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25269c-dd02-4c99-ac5a-d10da90084b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:51.458597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846095-b04c-4ba5-852b-7e68b4df9a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:51.461993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846095-b04c-4ba5-852b-7e68b4df9a83 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:51.472226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fa25269c-dd02-4c99-ac5a-d10da90084b6 None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:51.473495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fa25269c-dd02-4c99-ac5a-d10da90084b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:51.497812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 863/1735] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 872 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:51.502320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:51.502646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:51.504535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:51.608528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] MFA Rules not processed for user `84db604547a54b5e94d5295ee1d70fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:51.609799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:51.657449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:51.714853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 873/1736] 10.222.0.121 () {58 vars in 1063 bytes} [Mon Aug 1 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:51.723771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:51.726873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af695-7f7a-495c-93c7-5d367212b265 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:51.727176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af695-7f7a-495c-93c7-5d367212b265 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:51.727468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af695-7f7a-495c-93c7-5d367212b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:51.796080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 864/1737] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:51.796774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:51.800671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:51.815918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c86af695-7f7a-495c-93c7-5d367212b265 None None] MFA Rules not processed for user `e6779c1c95ee4cdebbee060460dad5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:51.817202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c86af695-7f7a-495c-93c7-5d367212b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:51.971141 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c08ee-b651-435d-8de6-d94915895a48 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:52.020136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:52.021052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:52.021885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:52.022395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] PATH_INFO: `/v3/projects/9b70a8fa9d7b4b83b8e5d738a6fa93c7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:52.025314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b70a8fa9d7b4b83b8e5d738a6fa93c7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:52.029963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:52.142138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 874/1738] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:52.146716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af695-7f7a-495c-93c7-5d367212b265 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:52.192426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b70a8fa9d7b4b83b8e5d738a6fa93c7', 'request_id': 'req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:52.205625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b70a8fa9d7b4b83b8e5d738a6fa93c7', 'request_id': 'req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:52.228660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af695-7f7a-495c-93c7-5d367212b265 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:52.230129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b70a8fa9d7b4b83b8e5d738a6fa93c7', 'request_id': 'req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:52.267056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] The token cache is being invalidate because project 9b70a8fa9d7b4b83b8e5d738a6fa93c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:52.267754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:52.272054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:52.277016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 865/1739] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:51 2022] DELETE /identity/v3/projects/9b70a8fa9d7b4b83b8e5d738a6fa93c7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:52.281403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:52.292005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:52.611199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:52.611974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:52.612333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:52.612880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:52.617998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:52.618671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c425f-1f9a-4fd6-b3f8-f4ef0f6d18f4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:52.631149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:52.632049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:52.632473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:52.633531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:52.641475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:52.673413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:52.684911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:52.720189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 875/1740] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:52.725695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:52.735584 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:52.736276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:52.818081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:52.819621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:52.871685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 866/1741] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:52.872741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:52.881383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:52.965453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c985e-f24c-4f11-b501-66f32b2f70df service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:52.994601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:52.995189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:52.995466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:52.998015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:53.033787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:53.035656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:53.074275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 867/1742] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:53.075219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:53.080511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:53.141706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa99a-ef0d-4e26-a6e3-9ca64652ec2c service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:53.164937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:53.166825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:53.170674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:53.171168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] PATH_INFO: `/v3/users/a08255297ad8474fb53015c6d79ebcb1` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:53.176885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08255297ad8474fb53015c6d79ebcb1)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:53.179359 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:53.216673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:53.340005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08255297ad8474fb53015c6d79ebcb1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:53.366026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08255297ad8474fb53015c6d79ebcb1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:53.415811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c3b89-377b-4098-82a2-b03c38da11f7 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:53.416705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08255297ad8474fb53015c6d79ebcb1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:53.422140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08255297ad8474fb53015c6d79ebcb1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:53.425319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b8ba5cb6-e23c-4e06-9547-ca6d4435543a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08255297ad8474fb53015c6d79ebcb1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:53.439426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:53.440943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:53.442633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:53.443091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:53.451385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:53.494591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 876/1743] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:03:52 2022] DELETE /identity/v3/users/a08255297ad8474fb53015c6d79ebcb1 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:53.513846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add60c3-1cfa-4ecb-80ea-739c7f3f3807 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:53.514543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add60c3-1cfa-4ecb-80ea-739c7f3f3807 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:53.515696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add60c3-1cfa-4ecb-80ea-739c7f3f3807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:53.563870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7add60c3-1cfa-4ecb-80ea-739c7f3f3807 None None] MFA Rules not processed for user `5c607e35877c4872a448c9a5e8a8a29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:53.566194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7add60c3-1cfa-4ecb-80ea-739c7f3f3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:53.738860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 877/1744] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:53.762520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:53.767549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:53.812465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 868/1745] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:03:54.482994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a08bc-7531-4555-8f5d-523842cb703a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:54.483670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a08bc-7531-4555-8f5d-523842cb703a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:54.484515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a08bc-7531-4555-8f5d-523842cb703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:54.547807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-471a08bc-7531-4555-8f5d-523842cb703a None None] MFA Rules not processed for user `cc1712f30dcc4ff4b350c91c76f5a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:54.551755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-471a08bc-7531-4555-8f5d-523842cb703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:54.749680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 878/1746] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:55.781355 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:55.783365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:55.821855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfc8a3-0a40-42cb-9062-33d28cb982a9 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:55.967707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:55.984121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:55.985132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:55.986138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:55.986639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] PATH_INFO: `/v3/projects/a358c6156cc34d15b0dc1493d30990d1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:55.988660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a358c6156cc34d15b0dc1493d30990d1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:55.992150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:56.071935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a358c6156cc34d15b0dc1493d30990d1', 'request_id': 'req-dc3eca0d-7664-4c1a-adcf-820522f3f413'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:56.089865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a358c6156cc34d15b0dc1493d30990d1', 'request_id': 'req-dc3eca0d-7664-4c1a-adcf-820522f3f413'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:56.095650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a358c6156cc34d15b0dc1493d30990d1', 'request_id': 'req-dc3eca0d-7664-4c1a-adcf-820522f3f413'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:56.113861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] The token cache is being invalidate because project a358c6156cc34d15b0dc1493d30990d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:03:56.114231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:56.115260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc3eca0d-7664-4c1a-adcf-820522f3f413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:03:56.122509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9881be3-5e37-4e7a-aec4-fb05c9532bb2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:56.123689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9881be3-5e37-4e7a-aec4-fb05c9532bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:56.123689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9881be3-5e37-4e7a-aec4-fb05c9532bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:56.133956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 869/1747] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:03:55 2022] DELETE /identity/v3/projects/a358c6156cc34d15b0dc1493d30990d1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:56.175510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d9881be3-5e37-4e7a-aec4-fb05c9532bb2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:56.176778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d9881be3-5e37-4e7a-aec4-fb05c9532bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:56.262733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:56.330829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 879/1748] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:56.341486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587adeb0-73e7-437c-a6ff-e4fd09094bf8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:56.342622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587adeb0-73e7-437c-a6ff-e4fd09094bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:56.342858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587adeb0-73e7-437c-a6ff-e4fd09094bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:56.412796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-587adeb0-73e7-437c-a6ff-e4fd09094bf8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:56.415840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-587adeb0-73e7-437c-a6ff-e4fd09094bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:56.427908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 870/1749] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:56.432145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9881be3-5e37-4e7a-aec4-fb05c9532bb2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:56.451013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9881be3-5e37-4e7a-aec4-fb05c9532bb2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:56.467535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:56.468400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:56.468717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:56.468998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:56.477363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:03:56.477695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:56.486092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:56.533940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 880/1750] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:03:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:03:56.536272 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587adeb0-73e7-437c-a6ff-e4fd09094bf8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:56.554973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587adeb0-73e7-437c-a6ff-e4fd09094bf8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:56.579274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:56.579472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:56.579932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:56.580216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:56.593691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:56.600058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:56.718754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:56.722304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:56.778744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 871/1751] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:56 2022] POST /identity/v3/projects => generated 386 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:56.783457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:56.953954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ebac-6eee-435b-87b2-44c3d24ea6c7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:57.121145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e6311-02d9-4d3c-ba16-4aa7d53d8854 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:57.190118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:57.192113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:57.194017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:57.195809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:57.216093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:57.233029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:57.280270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe592c0-7212-4653-bed1-d6021fa301d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:57.281571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe592c0-7212-4653-bed1-d6021fa301d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:57.282013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe592c0-7212-4653-bed1-d6021fa301d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:57.282486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe592c0-7212-4653-bed1-d6021fa301d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:57.286830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5fe592c0-7212-4653-bed1-d6021fa301d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:57.349132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 872/1752] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:56 2022] POST /identity/v3/users => generated 294 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:57.351573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:57.391997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a08d9e-aa77-4508-863e-6178d12c6483 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:57.404852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:57.406063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:57.406628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:57.407113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:57.416745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:57.420890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:57.448662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 873/1753] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:57 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:57.451367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:57.505652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8f433-6764-4ce5-be6c-c053c9a9363b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:57.535627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:57.536691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:57.538676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:57.539190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:57.564453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:57.578358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:57.637866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 874/1754] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:57 2022] GET /identity/v3/roles => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:57.641983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:57.654996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe592c0-7212-4653-bed1-d6021fa301d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:57.656481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe592c0-7212-4653-bed1-d6021fa301d4 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:57.687977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0818059-d6e0-4fe3-9bb4-3829847f0c59 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:57.709338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:57.710460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:57.710854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:57.711312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] PATH_INFO: `/v3/projects/30687f2629184b73b4afabf45bc7b5c6/users/4980eb496bee48aebf288ae72f4cb3fb/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:57.735726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 881/1755] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 1018 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:03:57.806324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30687f2629184b73b4afabf45bc7b5c6, user_id=4980eb496bee48aebf288ae72f4cb3fb, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:57.838440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:57.858757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:57.919718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 875/1756] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:57 2022] PUT /identity/v3/projects/30687f2629184b73b4afabf45bc7b5c6/users/4980eb496bee48aebf288ae72f4cb3fb/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:57.921119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faea55-114e-40b6-b55d-bd3cd2984b96 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:57.922941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faea55-114e-40b6-b55d-bd3cd2984b96 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:57.922941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faea55-114e-40b6-b55d-bd3cd2984b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:58.062557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f5faea55-114e-40b6-b55d-bd3cd2984b96 None None] MFA Rules not processed for user `4980eb496bee48aebf288ae72f4cb3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:58.063800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5faea55-114e-40b6-b55d-bd3cd2984b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:58.123635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:58.278422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 882/1757] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:03:58.279834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:58.459696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc3df0-da48-468f-9a53-3e208f98fa79 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:58.485280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:58.485871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:58.486157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:58.486464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:58.487272 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:58.489262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:58.580921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 876/1758] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:03:58 2022] POST /identity/v3/projects => generated 384 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:03:58.585755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faea55-114e-40b6-b55d-bd3cd2984b96 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:58.605990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faea55-114e-40b6-b55d-bd3cd2984b96 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:58.796136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894cd11-f2ad-4b38-ad93-8cf35782c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:58.797467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894cd11-f2ad-4b38-ad93-8cf35782c8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:58.798463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894cd11-f2ad-4b38-ad93-8cf35782c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:58.799141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894cd11-f2ad-4b38-ad93-8cf35782c8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:58.800783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894cd11-f2ad-4b38-ad93-8cf35782c8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:58.803652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894cd11-f2ad-4b38-ad93-8cf35782c8a5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:58.889883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 883/1759] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:03:58 2022] POST /identity/v3/users => generated 299 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:03:58.893920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:58.910393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948d8e-4cb6-4cef-a68d-34c631e0bac2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:58.910775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948d8e-4cb6-4cef-a68d-34c631e0bac2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:58.911101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4948d8e-4cb6-4cef-a68d-34c631e0bac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:58.914917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f22f0a-e942-4d7d-a934-a5958a4166e5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:58.943343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3612-279d-4084-b103-630b76933438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:58.952740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3612-279d-4084-b103-630b76933438 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:58.953034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3612-279d-4084-b103-630b76933438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:58.954844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b3612-279d-4084-b103-630b76933438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:58.955741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b3612-279d-4084-b103-630b76933438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:58.959620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b3612-279d-4084-b103-630b76933438 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:58.988937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 877/1760] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:58 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:58.991428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3612-279d-4084-b103-630b76933438 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:59.012776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b3612-279d-4084-b103-630b76933438 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:59.023667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:59.027275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:59.027574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:59.027856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] PATH_INFO: `/v3/projects/75be85e679454282b1d2a18d5ce9e994/users/f37616bbcdb1436ca2cf4545f2ed70bb/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:59.058908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e4948d8e-4cb6-4cef-a68d-34c631e0bac2 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:59.060177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e4948d8e-4cb6-4cef-a68d-34c631e0bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:59.079798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be85e679454282b1d2a18d5ce9e994, user_id=f37616bbcdb1436ca2cf4545f2ed70bb, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:59.083627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:59.105522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 878/1761] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:58 2022] PUT /identity/v3/projects/75be85e679454282b1d2a18d5ce9e994/users/f37616bbcdb1436ca2cf4545f2ed70bb/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:59.109959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:59.224047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 884/1762] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 01 17:03:59.331169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b38e-02d9-488b-8471-2a4e236a3cfd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:59.352908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7992eb8-b147-40a2-a370-db687f445eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:59.356211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992eb8-b147-40a2-a370-db687f445eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:59.358536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992eb8-b147-40a2-a370-db687f445eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:59.359851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7992eb8-b147-40a2-a370-db687f445eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:59.360780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7992eb8-b147-40a2-a370-db687f445eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:59.373210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7992eb8-b147-40a2-a370-db687f445eb2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:59.407882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 879/1763] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:03:59 2022] GET /identity/v3/roles => generated 1427 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:03:59.411719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4948d8e-4cb6-4cef-a68d-34c631e0bac2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:59.433913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4948d8e-4cb6-4cef-a68d-34c631e0bac2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:59.445819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:59.447570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:59.450543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:59.451112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] PATH_INFO: `/v3/projects/75be85e679454282b1d2a18d5ce9e994/users/f37616bbcdb1436ca2cf4545f2ed70bb/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:59.456336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75be85e679454282b1d2a18d5ce9e994, user_id=f37616bbcdb1436ca2cf4545f2ed70bb, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:03:59.461144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:03:59.501638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 885/1764] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:03:59 2022] PUT /identity/v3/projects/75be85e679454282b1d2a18d5ce9e994/users/f37616bbcdb1436ca2cf4545f2ed70bb/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:03:59.503696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd793a-e4bf-4ca7-8a42-4be11f93598f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:59.504019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd793a-e4bf-4ca7-8a42-4be11f93598f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:59.504264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd793a-e4bf-4ca7-8a42-4be11f93598f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:59.570412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:59.573106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:59.587526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ecbd793a-e4bf-4ca7-8a42-4be11f93598f None None] MFA Rules not processed for user `f37616bbcdb1436ca2cf4545f2ed70bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:03:59.589132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ecbd793a-e4bf-4ca7-8a42-4be11f93598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:03:59.596208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:59.673302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:03:59.809059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 880/1765] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:03:59.832681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23f89e-4252-42af-9a6f-8733d6a0149b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:03:59.834171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd793a-e4bf-4ca7-8a42-4be11f93598f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:03:59.848024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a9e50-4bf6-48d9-bc7c-b5c213a2eaa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:03:59.848687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a9e50-4bf6-48d9-bc7c-b5c213a2eaa4 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:03:59.881478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a9e50-4bf6-48d9-bc7c-b5c213a2eaa4 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:03:59.881944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a9e50-4bf6-48d9-bc7c-b5c213a2eaa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:03:59.992506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd793a-e4bf-4ca7-8a42-4be11f93598f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:00.008278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:00.011214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:00.011826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:00.013431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:00.045828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:00.048937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:00.071780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a9e50-4bf6-48d9-bc7c-b5c213a2eaa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:00.074854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a9e50-4bf6-48d9-bc7c-b5c213a2eaa4 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:00.102681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 881/1766] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:00.119147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 886/1767] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 17:04:00.133001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:00.267526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90787-89d5-45c3-bae6-cc849e879d1a service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:00.273373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:00.274350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:00.274751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:00.276302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] PATH_INFO: `/v3/users/4980eb496bee48aebf288ae72f4cb3fb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:00.277749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4980eb496bee48aebf288ae72f4cb3fb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:00.281170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:00.393233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4980eb496bee48aebf288ae72f4cb3fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:00.446277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4980eb496bee48aebf288ae72f4cb3fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:00.451192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4980eb496bee48aebf288ae72f4cb3fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:00.458220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4980eb496bee48aebf288ae72f4cb3fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:00.511594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4980eb496bee48aebf288ae72f4cb3fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:00.575512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:00.613566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 882/1768] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:00 2022] DELETE /identity/v3/users/4980eb496bee48aebf288ae72f4cb3fb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:00.615456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27bf9-d848-4aab-b12f-c768d3372cb5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:00.615973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27bf9-d848-4aab-b12f-c768d3372cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:00.616283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27bf9-d848-4aab-b12f-c768d3372cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:00.678336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fab27bf9-d848-4aab-b12f-c768d3372cb5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:00.680683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fab27bf9-d848-4aab-b12f-c768d3372cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:00.778162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 887/1769] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:01.121913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:01.124955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:01.300774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0cd84-ddcd-4ec5-b75e-0d47fcda0cac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:01.301580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:01.302247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:01.302552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:01.302999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:01.330215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:01.333948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:01.369670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 883/1770] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:02.306046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:02.307505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:02.307628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:02.348994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] MFA Rules not processed for user `112c65065f6d4c5990f3952e0099cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:02.350305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:02.375668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 888/1771] 10.222.0.36 () {58 vars in 1019 bytes} [Mon Aug 1 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:02.536069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:02.539005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:02.575441 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616e98b-ad27-4584-8053-125c3e4e38f6 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:02.597930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82b165-e5d1-49b2-9707-ee7b58f0fe0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:02.603027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b165-e5d1-49b2-9707-ee7b58f0fe0a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:02.604966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b165-e5d1-49b2-9707-ee7b58f0fe0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:02.605429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82b165-e5d1-49b2-9707-ee7b58f0fe0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:02.634144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82b165-e5d1-49b2-9707-ee7b58f0fe0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:02.641945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82b165-e5d1-49b2-9707-ee7b58f0fe0a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:02.683693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 884/1772] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:04.124651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:04.126464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:04.177574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6544709-2f49-450f-928c-e57a1a5d2ab3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:04.197882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:04.198620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:04.198905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:04.199182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] PATH_INFO: `/v3/users/c20a0999591b442a93bfa13a5736c37d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:04.201955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20a0999591b442a93bfa13a5736c37d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:04.208288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:04.265470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:04.322751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20a0999591b442a93bfa13a5736c37d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:04.338789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20a0999591b442a93bfa13a5736c37d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:04.371558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20a0999591b442a93bfa13a5736c37d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:04.375365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20a0999591b442a93bfa13a5736c37d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:04.379290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20a0999591b442a93bfa13a5736c37d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:04.410201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 889/1773] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:04 2022] DELETE /identity/v3/users/c20a0999591b442a93bfa13a5736c37d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:04.414844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc7b9a-f2a8-4ee3-914f-0090917be88d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:04.415407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc7b9a-f2a8-4ee3-914f-0090917be88d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:04.415776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc7b9a-f2a8-4ee3-914f-0090917be88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:04.464205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1fbc7b9a-f2a8-4ee3-914f-0090917be88d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:04.465794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1fbc7b9a-f2a8-4ee3-914f-0090917be88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:04.629655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 885/1774] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:04.731606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:04.733563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:04.872107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4b726-28ce-48a9-bf7e-9a57a2a5beb5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:04.902392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:04.903344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:04.903788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:04.904210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:04.928877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:04.930832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:04.961534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 890/1775] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:05.979789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055961e-0b93-4525-8617-3f68006119a7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:05.980281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055961e-0b93-4525-8617-3f68006119a7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:05.980404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055961e-0b93-4525-8617-3f68006119a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:06.016737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f055961e-0b93-4525-8617-3f68006119a7 None None] MFA Rules not processed for user `e6779c1c95ee4cdebbee060460dad5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:06.019693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f055961e-0b93-4525-8617-3f68006119a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:06.256774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 886/1776] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:06.829034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:06.832389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:06.956574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076c69c-61e5-4749-8792-e1e9c416fa2a service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:06.987424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:06.988832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:06.989425 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:06.990274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] PATH_INFO: `/v3/projects/30687f2629184b73b4afabf45bc7b5c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:06.996417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30687f2629184b73b4afabf45bc7b5c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:06.999596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:07.299489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30687f2629184b73b4afabf45bc7b5c6', 'request_id': 'req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:07.336361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30687f2629184b73b4afabf45bc7b5c6', 'request_id': 'req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:07.362400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30687f2629184b73b4afabf45bc7b5c6', 'request_id': 'req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:07.443036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] The token cache is being invalidate because project 30687f2629184b73b4afabf45bc7b5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:07.452061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:07.470035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e2045ad9-1ca0-4ea4-a542-53fffe951ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:07.479344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 891/1777] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:06 2022] DELETE /identity/v3/projects/30687f2629184b73b4afabf45bc7b5c6 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:07.483798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055961e-0b93-4525-8617-3f68006119a7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:07.523571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055961e-0b93-4525-8617-3f68006119a7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:07.656363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:07.821997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:07.823002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:07.823544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:07.823975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] PATH_INFO: `/v3/users/f37616bbcdb1436ca2cf4545f2ed70bb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:07.830515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37616bbcdb1436ca2cf4545f2ed70bb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:07.833566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:07.970007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37616bbcdb1436ca2cf4545f2ed70bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:07.999159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37616bbcdb1436ca2cf4545f2ed70bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:08.006928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37616bbcdb1436ca2cf4545f2ed70bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:08.008378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37616bbcdb1436ca2cf4545f2ed70bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:08.031122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0f73483-0fb5-44ee-8767-5ca5dc99a844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37616bbcdb1436ca2cf4545f2ed70bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:08.099204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 887/1778] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:07 2022] DELETE /identity/v3/users/f37616bbcdb1436ca2cf4545f2ed70bb => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:09.291623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29abb1-5c6c-4e79-ad49-4d82329c8ef1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:09.292653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29abb1-5c6c-4e79-ad49-4d82329c8ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:09.293079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29abb1-5c6c-4e79-ad49-4d82329c8ef1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:09.295183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 892/1779] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:04:09 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:04:09.445038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354bcd5-6b55-4c05-9b58-d725a1b7d5bc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:09.445617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354bcd5-6b55-4c05-9b58-d725a1b7d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:09.445617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354bcd5-6b55-4c05-9b58-d725a1b7d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:09.497541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5354bcd5-6b55-4c05-9b58-d725a1b7d5bc None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:09.502359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5354bcd5-6b55-4c05-9b58-d725a1b7d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:09.776224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 888/1780] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:09.924816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93533ecc-5f1c-4a5a-a625-9b35fed7bcd7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:09.925404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93533ecc-5f1c-4a5a-a625-9b35fed7bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:09.925852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93533ecc-5f1c-4a5a-a625-9b35fed7bcd7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:09.929124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 893/1781] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:04:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:04:10.238554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:10.238872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:10.239203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:10.285710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:10.292267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:10.327811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 889/1782] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:04:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:13.134864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93533ecc-5f1c-4a5a-a625-9b35fed7bcd7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:13.138493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93533ecc-5f1c-4a5a-a625-9b35fed7bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:13.229010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:13.231455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:13.271210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:13.420996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93533ecc-5f1c-4a5a-a625-9b35fed7bcd7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:13.427804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:13.429026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:13.429785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:13.430435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:13.447070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] PATH_INFO: `/v3/projects/75be85e679454282b1d2a18d5ce9e994` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:13.478833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75be85e679454282b1d2a18d5ce9e994)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:13.490069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:13.523238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55425c9f-17ca-409c-b99b-c80ddfb3c4c9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:13.544910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:13.549402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:13.549697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:13.549983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] PATH_INFO: `/v3/projects/33efd17965ee48d0bf9e8c1903b544ff` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:13.555019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33efd17965ee48d0bf9e8c1903b544ff)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:13.564630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:13.593850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75be85e679454282b1d2a18d5ce9e994', 'request_id': 'req-cb6f331d-43b5-4561-9b96-342952932cc4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.626002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75be85e679454282b1d2a18d5ce9e994', 'request_id': 'req-cb6f331d-43b5-4561-9b96-342952932cc4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.650881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75be85e679454282b1d2a18d5ce9e994', 'request_id': 'req-cb6f331d-43b5-4561-9b96-342952932cc4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.673874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33efd17965ee48d0bf9e8c1903b544ff', 'request_id': 'req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.674171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] The token cache is being invalidate because project 75be85e679454282b1d2a18d5ce9e994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:13.674392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.675544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.680710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 894/1783] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:13 2022] DELETE /identity/v3/projects/75be85e679454282b1d2a18d5ce9e994 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:13.682299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:13.683967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:13.685832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33efd17965ee48d0bf9e8c1903b544ff', 'request_id': 'req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.704180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33efd17965ee48d0bf9e8c1903b544ff', 'request_id': 'req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.729324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] The token cache is being invalidate because project 33efd17965ee48d0bf9e8c1903b544ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:13.729653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.730860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:13.733368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 890/1784] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:13 2022] DELETE /identity/v3/projects/33efd17965ee48d0bf9e8c1903b544ff => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:13.743360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:13.745618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:13.805956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f331d-43b5-4561-9b96-342952932cc4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:13.905878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:13.919260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ee55-1cfc-44c4-8b1c-fb7b5a58d586 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:13.927617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b41e9-eb0a-4088-91cd-04d943c5e173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:13.928672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b41e9-eb0a-4088-91cd-04d943c5e173 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:13.929198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b41e9-eb0a-4088-91cd-04d943c5e173 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:13.929892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:13.930487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b41e9-eb0a-4088-91cd-04d943c5e173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:13.930797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:13.931458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:13.931746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:13.934144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-272b41e9-eb0a-4088-91cd-04d943c5e173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:13.936398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:13.952309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b41e9-eb0a-4088-91cd-04d943c5e173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:13.953930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b41e9-eb0a-4088-91cd-04d943c5e173 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:13.957738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:13.959857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:13.968334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 891/1785] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:13.969693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7893a6-370b-48b6-94d6-42710ad1946f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:13.969985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7893a6-370b-48b6-94d6-42710ad1946f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:13.970503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7893a6-370b-48b6-94d6-42710ad1946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:13.975690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 895/1786] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:13.976489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:13.978171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:14.025456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3b7893a6-370b-48b6-94d6-42710ad1946f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:14.026762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3b7893a6-370b-48b6-94d6-42710ad1946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:14.086117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb089903-031d-47e8-8487-cc91196754ae service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:14.098480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:14.100041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.100499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.103696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] PATH_INFO: `/v3/users/707f290a19db43c1a235ddf5e23b6511` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.108643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=707f290a19db43c1a235ddf5e23b6511)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:14.114788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:14.147031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:14.201154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 892/1787] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:14.216170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e414-3492-40ec-b557-5efb06b7d181 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.216701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e414-3492-40ec-b557-5efb06b7d181 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.217178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29e414-3492-40ec-b557-5efb06b7d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.222132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707f290a19db43c1a235ddf5e23b6511'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:14.240204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707f290a19db43c1a235ddf5e23b6511'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:14.260783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1e29e414-3492-40ec-b557-5efb06b7d181 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:14.262667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e29e414-3492-40ec-b557-5efb06b7d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:14.281070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 893/1788] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:14.282688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29e414-3492-40ec-b557-5efb06b7d181 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:14.297429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707f290a19db43c1a235ddf5e23b6511'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:14.298243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707f290a19db43c1a235ddf5e23b6511'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:14.299576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707f290a19db43c1a235ddf5e23b6511'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:14.305596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29e414-3492-40ec-b557-5efb06b7d181 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:14.319196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:14.320442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.323469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 896/1789] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:13 2022] DELETE /identity/v3/users/707f290a19db43c1a235ddf5e23b6511 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:14.323666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.324062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.326537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:14.326887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:14.328569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:14.385554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 894/1790] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:14.385887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:14.400984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:14.550173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:14.556874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff092d0-db13-4aad-b5a4-5e1104c2d591 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:14.565443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:14.566724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.567859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.569314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.570523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:14.574943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:14.620546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:14.640653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 897/1791] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:14 2022] POST /identity/v3/projects => generated 380 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:14.645861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061819b7-f9a0-4279-a377-e388f138d3f5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:14.735614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:14.736468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.736809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.737064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.738804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:14.741279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:14.778585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 895/1792] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:14 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:14.780025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:14.799185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416f089-7492-4a6a-8045-49798406920c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:14.805530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:14.806717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.807017 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.807274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.808007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:14.810067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:14.826482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 898/1793] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:14 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:14.828110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:14.845200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7044-89e7-4dc5-9514-0049fbee384f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:14.851197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927825-8329-4577-b5bf-6434e07d45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:14.852020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927825-8329-4577-b5bf-6434e07d45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.852371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927825-8329-4577-b5bf-6434e07d45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.853242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927825-8329-4577-b5bf-6434e07d45c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.855208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db927825-8329-4577-b5bf-6434e07d45c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:14.856697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db927825-8329-4577-b5bf-6434e07d45c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:14.874382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 896/1794] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:14 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:14.876035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:14.904351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc11a56-aa20-4d66-b747-e53c9d286104 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:14.910583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:14.912927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.914152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.916293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] PATH_INFO: `/v3/projects/91dff1d14c524857a3da34475b2f8ec0/users/a7e3a28408af4f64b226363d2ab09faf/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:14.939056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dff1d14c524857a3da34475b2f8ec0, user_id=a7e3a28408af4f64b226363d2ab09faf, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:14.943328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:14.975099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 899/1795] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:14 2022] PUT /identity/v3/projects/91dff1d14c524857a3da34475b2f8ec0/users/a7e3a28408af4f64b226363d2ab09faf/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:14.981993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8e54-c129-4934-9a79-bb33a76d6b99 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:14.982362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8e54-c129-4934-9a79-bb33a76d6b99 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:14.982654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8e54-c129-4934-9a79-bb33a76d6b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.014562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-873b8e54-c129-4934-9a79-bb33a76d6b99 None None] MFA Rules not processed for user `a7e3a28408af4f64b226363d2ab09faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:15.015829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-873b8e54-c129-4934-9a79-bb33a76d6b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.048471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.051434 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.122151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 897/1796] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:15.127187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8e54-c129-4934-9a79-bb33a76d6b99 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.145446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4514327-627b-464c-89bf-93a9e2ce6939 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.152695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.153367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.153655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.153933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] PATH_INFO: `/v3/projects/793d50e9d6b749edb64bf33652d9640a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.155691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793d50e9d6b749edb64bf33652d9640a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.158078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.173266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:15.200743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8e54-c129-4934-9a79-bb33a76d6b99 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.208378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793d50e9d6b749edb64bf33652d9640a', 'request_id': 'req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.215434 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793d50e9d6b749edb64bf33652d9640a', 'request_id': 'req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.224348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793d50e9d6b749edb64bf33652d9640a', 'request_id': 'req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.237260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] The token cache is being invalidate because project 793d50e9d6b749edb64bf33652d9640a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:15.237553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.238237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ef6f8efd-fb69-4e97-b4f7-fad07b51c8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.239860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 900/1797] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:15 2022] DELETE /identity/v3/projects/793d50e9d6b749edb64bf33652d9640a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:15.248218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa059d-ee36-471a-9f31-f4e2ac603a75 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.248509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa059d-ee36-471a-9f31-f4e2ac603a75 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.248821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa059d-ee36-471a-9f31-f4e2ac603a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.267885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.269219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.269219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.269843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.270681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.271299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-15fa059d-ee36-471a-9f31-f4e2ac603a75 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:15.272511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-15fa059d-ee36-471a-9f31-f4e2ac603a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.272935 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.282205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 901/1798] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:15.292208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765244-0461-47c0-9911-6cd8d118f060 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.292502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765244-0461-47c0-9911-6cd8d118f060 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.292785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765244-0461-47c0-9911-6cd8d118f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.309265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 898/1799] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:15 2022] POST /identity/v3/projects => generated 382 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:15.314207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.314440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-79765244-0461-47c0-9911-6cd8d118f060 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:15.315718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-79765244-0461-47c0-9911-6cd8d118f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.316309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.365806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:15.388511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0afbf-e3c9-4f02-9291-b17afbb0003d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.393528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.394147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.394465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.394750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.395420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.397364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.404424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 902/1800] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:15.408786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79765244-0461-47c0-9911-6cd8d118f060 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.418532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79765244-0461-47c0-9911-6cd8d118f060 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.424628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 899/1801] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:15 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:15.429517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.432044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.432704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.432987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.433261 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.434077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:15.434515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.436331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.448978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30353492-ec76-479e-a941-a43a60941d49 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.449535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 903/1802] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:15.450413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.452095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.454377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.455079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.455370 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.455650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.456365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.458001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.465471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efac5b7-1912-4645-a39e-93c8a0769d2b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.471112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 900/1803] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:15 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:15.472080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.472738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.473024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.473305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] PATH_INFO: `/v3/users/0963bb74acee4d4bb30856b9e19962d8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.475068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.475205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0963bb74acee4d4bb30856b9e19962d8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.477271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.485572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449bbd-b421-468e-ac81-b9f682bfedeb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.490510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.491148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.491433 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.491709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.492485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.494988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.526494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 901/1804] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:15 2022] POST /identity/v3/projects => generated 368 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:15.530151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.538936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0963bb74acee4d4bb30856b9e19962d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.548284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0963bb74acee4d4bb30856b9e19962d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.556949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:15.575096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0963bb74acee4d4bb30856b9e19962d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.576491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0963bb74acee4d4bb30856b9e19962d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.577794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0963bb74acee4d4bb30856b9e19962d8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:15.599239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 904/1805] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:15 2022] DELETE /identity/v3/users/0963bb74acee4d4bb30856b9e19962d8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:15.603464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.604939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.612446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9747dc-83e1-41c3-944f-1b3a79343fc9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.686124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5193d-a48e-48a4-a949-7d7a35ef3c89 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.691848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e2a2-90f8-4d8b-aedc-c7df091db330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.692486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e2a2-90f8-4d8b-aedc-c7df091db330 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.692774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e2a2-90f8-4d8b-aedc-c7df091db330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.692960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.693163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e2a2-90f8-4d8b-aedc-c7df091db330 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.693640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.693807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e2a2-90f8-4d8b-aedc-c7df091db330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.693909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.694192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] PATH_INFO: `/v3/projects/0f78e81bd91e46b3afaab82388e53a8c/users/abdf893d87c24f51ad6acbca256c553a/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.695823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e2a2-90f8-4d8b-aedc-c7df091db330 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.709967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f78e81bd91e46b3afaab82388e53a8c, user_id=abdf893d87c24f51ad6acbca256c553a, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.713023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.725337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 905/1806] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:15 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:15.726739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26a92-7f29-40f8-95d5-550ce0ab58c6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.727025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26a92-7f29-40f8-95d5-550ce0ab58c6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.727302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad26a92-7f29-40f8-95d5-550ce0ab58c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.741726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 902/1807] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:15 2022] PUT /identity/v3/projects/0f78e81bd91e46b3afaab82388e53a8c/users/abdf893d87c24f51ad6acbca256c553a/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:15.741726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.765541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-bad26a92-7f29-40f8-95d5-550ce0ab58c6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:15.768179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bad26a92-7f29-40f8-95d5-550ce0ab58c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.798688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:15.845099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b72f4-764d-469a-8351-a91942f50de1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.849943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.850692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.851350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.851350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.852206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.854620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.865304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 903/1808] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:15 2022] GET /identity/v3/roles => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:15.869137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.870501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.883123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 906/1809] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:15.884180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc03cb-e927-4779-8c1d-47dc13b95704 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.884757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad26a92-7f29-40f8-95d5-550ce0ab58c6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.897099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.897927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.898219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.898646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.899751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.903496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad26a92-7f29-40f8-95d5-550ce0ab58c6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.904246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.918826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 904/1810] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:15 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:15.918826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.921117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:15.923412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.924026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.924323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.924585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.925742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.927053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.938563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 907/1811] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:15 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:15.939408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.950852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e817fb-a1b6-4a4f-890e-b32e140dfa4c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:15.955756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:15.956430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:15.956712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:15.957014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] PATH_INFO: `/v3/projects/0f78e81bd91e46b3afaab82388e53a8c/users/abdf893d87c24f51ad6acbca256c553a/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:15.959057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f78e81bd91e46b3afaab82388e53a8c, user_id=abdf893d87c24f51ad6acbca256c553a, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:15.962206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:15.978374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 908/1812] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:15 2022] PUT /identity/v3/projects/0f78e81bd91e46b3afaab82388e53a8c/users/abdf893d87c24f51ad6acbca256c553a/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:15.982418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:15.987434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:16.004156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f4112-b13d-4b8b-8288-cf0e40ab3001 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.051894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf730b5-98d6-46e8-870c-a74ce8302346 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.054541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522008f-9646-449c-94b1-14f922bebf0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.055182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522008f-9646-449c-94b1-14f922bebf0a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.055462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522008f-9646-449c-94b1-14f922bebf0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.055759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522008f-9646-449c-94b1-14f922bebf0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.059473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b937e7-2d36-4b59-9642-4f86e5f845f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.060161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b937e7-2d36-4b59-9642-4f86e5f845f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.060580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b937e7-2d36-4b59-9642-4f86e5f845f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.060788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b937e7-2d36-4b59-9642-4f86e5f845f9 admin admin] PATH_INFO: `/v3/projects/43a1dbd2e6dc401ca03ec500b3c81633/users/0233881acee2434b80baf49be6342874/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.066837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522008f-9646-449c-94b1-14f922bebf0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.068368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522008f-9646-449c-94b1-14f922bebf0a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.076569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b937e7-2d36-4b59-9642-4f86e5f845f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43a1dbd2e6dc401ca03ec500b3c81633, user_id=0233881acee2434b80baf49be6342874, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.078807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 905/1813] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:16.079413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b937e7-2d36-4b59-9642-4f86e5f845f9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.080142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.080434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.080758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.107155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 909/1814] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:15 2022] PUT /identity/v3/projects/43a1dbd2e6dc401ca03ec500b3c81633/users/0233881acee2434b80baf49be6342874/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:16.117787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b5306-6678-4ff6-a14a-e3d2c8f3e82a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.118077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b5306-6678-4ff6-a14a-e3d2c8f3e82a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.118819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b5306-6678-4ff6-a14a-e3d2c8f3e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.129825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] MFA Rules not processed for user `abdf893d87c24f51ad6acbca256c553a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:16.132006 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.193876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5a0b5306-6678-4ff6-a14a-e3d2c8f3e82a None None] MFA Rules not processed for user `0233881acee2434b80baf49be6342874`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:16.197614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5a0b5306-6678-4ff6-a14a-e3d2c8f3e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.242359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 906/1815] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:16.243589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.245834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.304227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 910/1816] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:16.309028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b5306-6678-4ff6-a14a-e3d2c8f3e82a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.322489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:16.338292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f8aec-5083-4592-b88e-fd0d6b9a6473 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.342634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.343285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.343553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.343839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.356221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.356648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.368526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 907/1817] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:16.419379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b5306-6678-4ff6-a14a-e3d2c8f3e82a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.425024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.425695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.425975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.426250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.426957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.431775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.432945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.434590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.458902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58856b-d996-405a-8a48-dadcd14c4d13 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.475512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.476228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 911/1818] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:16 2022] POST /identity/v3/projects => generated 370 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:16.479097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.480421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.480973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.482248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] PATH_INFO: `/v3/projects/f0832c0179e945ddbeee2f75535459dd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.483363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0832c0179e945ddbeee2f75535459dd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.485803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.537304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:16.592048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0832c0179e945ddbeee2f75535459dd', 'request_id': 'req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.597219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24422f-70c9-44e4-874e-4b5fbae32595 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.626210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0832c0179e945ddbeee2f75535459dd', 'request_id': 'req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.643724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0832c0179e945ddbeee2f75535459dd', 'request_id': 'req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.662452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] The token cache is being invalidate because project f0832c0179e945ddbeee2f75535459dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:16.662775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.663849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.669265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 908/1819] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:16 2022] DELETE /identity/v3/projects/f0832c0179e945ddbeee2f75535459dd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:16.670322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.677777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.695222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.696526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.697053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.697491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.699599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.703350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.739595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 912/1820] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:16 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:16.741326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.744743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.758128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9c7d7-ad49-4bca-9eef-e274a6c56908 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.764964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.765610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.765896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.766176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.766926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.768527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8bce8-ee63-4b4d-8310-6da5f22fb3c9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.768871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.778623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.779308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.779596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.779874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] PATH_INFO: `/v3/users/84db604547a54b5e94d5295ee1d70fdf` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.781836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=84db604547a54b5e94d5295ee1d70fdf)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.784184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.789683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 913/1821] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:16 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:16.791262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.803446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b0730-6561-48af-8eb0-d5d988947837 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.809811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:16.810623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:16.810972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:16.811323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] PATH_INFO: `/v3/projects/a2c16bbe704f4774b4877da670957bde/users/dde9f5a607514182a89c718db1b9cc03/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:16.835270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c16bbe704f4774b4877da670957bde, user_id=dde9f5a607514182a89c718db1b9cc03, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:16.839088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:16.842905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:16.859285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 914/1822] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:16 2022] PUT /identity/v3/projects/a2c16bbe704f4774b4877da670957bde/users/dde9f5a607514182a89c718db1b9cc03/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:16.860273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.861957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.863454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84db604547a54b5e94d5295ee1d70fdf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.872108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84db604547a54b5e94d5295ee1d70fdf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.872912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84db604547a54b5e94d5295ee1d70fdf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.873642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84db604547a54b5e94d5295ee1d70fdf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.888237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84db604547a54b5e94d5295ee1d70fdf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:16.910880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 909/1823] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:16 2022] DELETE /identity/v3/users/84db604547a54b5e94d5295ee1d70fdf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:16.912154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:16.913886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:16.950543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a1a73-709b-4c03-9603-e543e464ff46 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:16.952614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:17.007764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d907-43ec-40fb-ac55-4226f206f8cd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.015911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.016766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.017055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.017711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.018762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.022839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.024362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abdf893d87c24f51ad6acbca256c553a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f78e81bd91e46b3afaab82388e53a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.025671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.026203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.026755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.028019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:17.028741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.030909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.041057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 910/1824] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:16 2022] GET /identity/v3/roles => generated 1427 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:17.042537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.048806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 915/1825] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:17.053076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.055900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.059904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6943dba-44ef-419c-83ac-d1df61744671 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.065459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603ce3-28b9-471d-967b-b934213c7cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.066144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603ce3-28b9-471d-967b-b934213c7cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.066455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603ce3-28b9-471d-967b-b934213c7cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.066750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603ce3-28b9-471d-967b-b934213c7cec admin admin] PATH_INFO: `/v3/projects/a2c16bbe704f4774b4877da670957bde/users/dde9f5a607514182a89c718db1b9cc03/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.069120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603ce3-28b9-471d-967b-b934213c7cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c16bbe704f4774b4877da670957bde, user_id=dde9f5a607514182a89c718db1b9cc03, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.072759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603ce3-28b9-471d-967b-b934213c7cec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.075050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258d12-6884-46ba-9653-3530a818579d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.080917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abdf893d87c24f51ad6acbca256c553a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f78e81bd91e46b3afaab82388e53a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.081553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.081847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.082291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.082979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.084979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 911/1826] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:17 2022] PUT /identity/v3/projects/a2c16bbe704f4774b4877da670957bde/users/dde9f5a607514182a89c718db1b9cc03/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:17.085092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.096610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.096871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.097113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.125502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 916/1827] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:17 2022] POST /identity/v3/projects => generated 353 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:17.129038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.136522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] MFA Rules not processed for user `dde9f5a607514182a89c718db1b9cc03`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:17.137880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.206095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5ece3-1a8a-401d-8dff-bffdc95c6614 tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.211451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abdf893d87c24f51ad6acbca256c553a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f78e81bd91e46b3afaab82388e53a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.212304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.213172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.213848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.214179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:17.214768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.214891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 912/1828] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:17.216159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.225722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.228598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.230998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 917/1829] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:04:17.276630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.288063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38472b17-7e68-4ed0-a2b1-105bb4d4c4cf tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.295199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abdf893d87c24f51ad6acbca256c553a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f78e81bd91e46b3afaab82388e53a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.295825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.296254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.296530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] PATH_INFO: `/v3/projects/994c61580867455da563ff33af5c0793` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.297952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorizing `identity:delete_project(project_id=994c61580867455da563ff33af5c0793)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.300357 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.304385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:17.312557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7466b-5597-4627-93a1-0cda59438160 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.331513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.332395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.332597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.333007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.348255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.350707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.372234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 913/1830] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:17.395799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.397056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.426294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994c61580867455da563ff33af5c0793', 'request_id': 'req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.434717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994c61580867455da563ff33af5c0793', 'request_id': 'req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.444041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994c61580867455da563ff33af5c0793', 'request_id': 'req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.457397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] The token cache is being invalidate because project 994c61580867455da563ff33af5c0793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:17.457725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.458529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.460740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 918/1831] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:17 2022] DELETE /identity/v3/projects/994c61580867455da563ff33af5c0793 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:17.465080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.466647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.471711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:17.507855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48cf3-c718-45d0-803e-acc2823f6217 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.577065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc4f8d-e2d2-4f7e-886a-e5d4cb89c75d tempest-VolumeQuotaClassesTest-1819348386 tempest-VolumeQuotaClassesTest-1819348386-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.583233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.584238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.584559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.585074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.588050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.597673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.599087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.599087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.599351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] PATH_INFO: `/v3/projects/e6aac27851954c18bc01cfc2d2ce99c3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.601063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6aac27851954c18bc01cfc2d2ce99c3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.605873 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.662907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6aac27851954c18bc01cfc2d2ce99c3', 'request_id': 'req-79415eed-647c-4ae2-99e6-203a8b4d20ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.670359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6aac27851954c18bc01cfc2d2ce99c3', 'request_id': 'req-79415eed-647c-4ae2-99e6-203a8b4d20ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.681289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6aac27851954c18bc01cfc2d2ce99c3', 'request_id': 'req-79415eed-647c-4ae2-99e6-203a8b4d20ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.686638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.688107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.695341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] The token cache is being invalidate because project e6aac27851954c18bc01cfc2d2ce99c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:17.695628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.696408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-79415eed-647c-4ae2-99e6-203a8b4d20ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.697957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 914/1832] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:17 2022] DELETE /identity/v3/projects/e6aac27851954c18bc01cfc2d2ce99c3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:17.699537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 919/1833] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:17.702634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b83e-c0a0-493d-adc2-fe4c50409800 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.702924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b83e-c0a0-493d-adc2-fe4c50409800 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.703209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b83e-c0a0-493d-adc2-fe4c50409800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.723622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-62d5b83e-c0a0-493d-adc2-fe4c50409800 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:17.724986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-62d5b83e-c0a0-493d-adc2-fe4c50409800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.759725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.761348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.777726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5149c27-857c-4934-9d39-191519df6166 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.797884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 915/1834] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:17.807171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573abff7-da2d-4887-8e96-9354237f3fd4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.807475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573abff7-da2d-4887-8e96-9354237f3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.807749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573abff7-da2d-4887-8e96-9354237f3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.828020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:17.831195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-573abff7-da2d-4887-8e96-9354237f3fd4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:17.832954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-573abff7-da2d-4887-8e96-9354237f3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:17.842011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 916/1835] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:17.846492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.847338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573abff7-da2d-4887-8e96-9354237f3fd4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.858563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.858859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.859154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] PATH_INFO: `/v3/users/a7e3a28408af4f64b226363d2ab09faf` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.860024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573abff7-da2d-4887-8e96-9354237f3fd4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.862961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e3a28408af4f64b226363d2ab09faf)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.864995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.865466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.866170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.866516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.867036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.867760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:17.868544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.870671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.884503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:17.894539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 917/1836] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:04:17.896654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.910094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706d4cb-4277-4050-a9d2-f7fb71b5c5da admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:17.916518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:17.917280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:17.917692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:17.918182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:17.919742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:17.939024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e3a28408af4f64b226363d2ab09faf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.939715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:17.950736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e3a28408af4f64b226363d2ab09faf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.977364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e3a28408af4f64b226363d2ab09faf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.978475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e3a28408af4f64b226363d2ab09faf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.980754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 918/1837] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:17 2022] POST /identity/v3/projects => generated 386 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:17.981130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3b13621-64e5-4b73-bb88-f32fe2989958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e3a28408af4f64b226363d2ab09faf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:17.984977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:17.987915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:18.002899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 920/1838] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:17 2022] DELETE /identity/v3/users/a7e3a28408af4f64b226363d2ab09faf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:18.011961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.028576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.029325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.075366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:18.078007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:18.116997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5266cb-44a6-417e-ac26-1d0a88297f77 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:18.220717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 921/1839] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:18.245544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:18.246442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.246826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.247178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.247947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:18.250025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:18.277851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:18.279366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:18.294909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 919/1840] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:17 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:18.298868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:18.328742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c14f35-cd5f-4d65-8467-b21617d6ffd4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:18.352685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:18.352685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.355816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.355816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.355816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:18.357281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:18.382207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 920/1841] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:18 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:18.383216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:18.389638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ad3a4-88a6-441a-8a71-7ae37c5c2c18 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:18.397556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3509e6c-3982-46df-8862-048757097c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:18.400923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509e6c-3982-46df-8862-048757097c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.400923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509e6c-3982-46df-8862-048757097c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.400923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3509e6c-3982-46df-8862-048757097c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.418731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1e147-d28d-4d3d-be46-27f22b4f89b3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:18.456882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:18.457595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.457882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.458051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509e6c-3982-46df-8862-048757097c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:18.460874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.460874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:18.460874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:18.462496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3509e6c-3982-46df-8862-048757097c2f service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:18.491265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 921/1842] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:18 2022] GET /identity/v3/roles => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:18.496653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:18.500296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 922/1843] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:18.513721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97220702-85e9-4d39-88e3-4cd0cb9af538 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:18.521664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:18.522636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.523016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.523393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] PATH_INFO: `/v3/projects/8f73c520d76e444dbcc5ea193ca42b6e/users/4cebba128e1a4a25b2f70a7a10486a43/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.562015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f73c520d76e444dbcc5ea193ca42b6e, user_id=4cebba128e1a4a25b2f70a7a10486a43, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:18.565007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:18.603867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 922/1844] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:18 2022] PUT /identity/v3/projects/8f73c520d76e444dbcc5ea193ca42b6e/users/4cebba128e1a4a25b2f70a7a10486a43/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:18.616113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b7a96-8d4d-4b08-8452-7ab9cc8ca7d8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.616609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b7a96-8d4d-4b08-8452-7ab9cc8ca7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.616901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b7a96-8d4d-4b08-8452-7ab9cc8ca7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.643802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:18.660880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-230b7a96-8d4d-4b08-8452-7ab9cc8ca7d8 None None] MFA Rules not processed for user `4cebba128e1a4a25b2f70a7a10486a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:18.662636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-230b7a96-8d4d-4b08-8452-7ab9cc8ca7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:18.774330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 923/1845] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:18.776657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:18.817963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:18.864047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb28e0-038e-4c33-8939-c390e6baefc2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:18.871518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:18.872956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:18.874227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:18.874647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:18.875458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:18.877506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:18.933649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b7a96-8d4d-4b08-8452-7ab9cc8ca7d8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:18.933889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 923/1846] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:18 2022] POST /identity/v3/projects => generated 388 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:18.947498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b7a96-8d4d-4b08-8452-7ab9cc8ca7d8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:19.083026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:19.084003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:19.084476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:19.084847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:19.087476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:19.089585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:19.141075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 924/1847] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:18 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:19.143085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:19.157087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf736-b866-4142-8a0d-47a722f33705 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:19.167939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:19.169303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:19.169303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:19.170499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:19.171139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:19.173149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:19.202335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 924/1848] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:19 2022] GET /identity/v3/roles => generated 1427 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:19.205381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:19.218673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500ad4-ad36-4b8b-8949-8619a34f53b8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:19.225042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:19.225850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:19.226207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:19.226604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] PATH_INFO: `/v3/projects/f04dec27ec034c9bb24be088ed76b911/users/bcb9108a6dfd416eb1973088a69c4bc8/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:19.250946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04dec27ec034c9bb24be088ed76b911, user_id=bcb9108a6dfd416eb1973088a69c4bc8, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:19.253996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:19.272734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 925/1849] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:19 2022] PUT /identity/v3/projects/f04dec27ec034c9bb24be088ed76b911/users/bcb9108a6dfd416eb1973088a69c4bc8/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:19.278577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:19.304898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c569-bb59-4661-b3c3-f505f02f523d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:19.393621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dcc72-4a51-495e-8a60-4e6d52d13487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:19.394296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcc72-4a51-495e-8a60-4e6d52d13487 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:19.394492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcc72-4a51-495e-8a60-4e6d52d13487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:19.394822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dcc72-4a51-495e-8a60-4e6d52d13487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:19.396840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dcc72-4a51-495e-8a60-4e6d52d13487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:19.398477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dcc72-4a51-495e-8a60-4e6d52d13487 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:19.420296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:19.433180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 925/1850] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:19 2022] GET /identity/v3/roles => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:04:19.435385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e018c-6ff6-434e-bd13-cd9400f2e067 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:19.443080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:19.443566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:19.443861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:19.444418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] PATH_INFO: `/v3/projects/f04dec27ec034c9bb24be088ed76b911/users/bcb9108a6dfd416eb1973088a69c4bc8/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:19.448099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04dec27ec034c9bb24be088ed76b911, user_id=bcb9108a6dfd416eb1973088a69c4bc8, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:19.453646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:19.491511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 926/1851] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:19 2022] PUT /identity/v3/projects/f04dec27ec034c9bb24be088ed76b911/users/bcb9108a6dfd416eb1973088a69c4bc8/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:19.497388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3fecb-6c5f-4438-9165-bb94d020edd0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:19.497583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3fecb-6c5f-4438-9165-bb94d020edd0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:19.497812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3fecb-6c5f-4438-9165-bb94d020edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:19.534856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e7b3fecb-6c5f-4438-9165-bb94d020edd0 None None] MFA Rules not processed for user `bcb9108a6dfd416eb1973088a69c4bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:19.536755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e7b3fecb-6c5f-4438-9165-bb94d020edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:19.632334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 926/1852] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:19.655993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:19.657781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:19.749076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707f6cb-57d4-4d68-8ab9-11ba155458a8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:19.765952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:19.766931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:19.767526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:19.768060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:19.784344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:19.790784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:19.792331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:19.804933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 927/1853] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:20.764659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9775cd-53ac-4efd-9710-39dc653d885e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:20.765148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9775cd-53ac-4efd-9710-39dc653d885e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:20.765261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9775cd-53ac-4efd-9710-39dc653d885e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:20.766679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 927/1854] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:04:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:04:20.772669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:20.795204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:20.795501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:20.796270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:20.842717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:20.843805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:20.882033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:20.919736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f460-a612-4e7b-a56b-271eda85f0d2 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:20.954364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:20.955070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:20.955375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:20.955580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] PATH_INFO: `/v3/users/4cebba128e1a4a25b2f70a7a10486a43` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:20.956799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cebba128e1a4a25b2f70a7a10486a43)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:20.959027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:21.043677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 928/1855] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:04:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:21.075532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:21.078377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:21.091369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cebba128e1a4a25b2f70a7a10486a43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.104984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cebba128e1a4a25b2f70a7a10486a43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.128256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353de80-a123-4528-a3f7-88ce50258659 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:21.157582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a4d36-19c5-4383-917b-5f1d2090493f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:21.158174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a4d36-19c5-4383-917b-5f1d2090493f service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:21.158493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a4d36-19c5-4383-917b-5f1d2090493f service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:21.159136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a4d36-19c5-4383-917b-5f1d2090493f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:21.160706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cebba128e1a4a25b2f70a7a10486a43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.161439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cebba128e1a4a25b2f70a7a10486a43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.167466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cebba128e1a4a25b2f70a7a10486a43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.178364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a4d36-19c5-4383-917b-5f1d2090493f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:21.179911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a4d36-19c5-4383-917b-5f1d2090493f service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:21.193968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 929/1856] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:21.209674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 928/1857] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:20 2022] DELETE /identity/v3/users/4cebba128e1a4a25b2f70a7a10486a43 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:21.216552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:21.216552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:21.216851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:21.244826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:21.246880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:21.262072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:21.265791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:21.379581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c4cd-8bfa-4e09-b1eb-0b7c27d90ced admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:21.390231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:21.390735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:21.391498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:21.391498 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] PATH_INFO: `/v3/projects/91dff1d14c524857a3da34475b2f8ec0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:21.393989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91dff1d14c524857a3da34475b2f8ec0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:21.396074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:21.420940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:21.423348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 930/1858] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:21.435900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:21.439722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:21.483242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91dff1d14c524857a3da34475b2f8ec0', 'request_id': 'req-34ad5a8a-87cb-4a7a-886d-64438974201c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.500448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91dff1d14c524857a3da34475b2f8ec0', 'request_id': 'req-34ad5a8a-87cb-4a7a-886d-64438974201c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.518816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91dff1d14c524857a3da34475b2f8ec0', 'request_id': 'req-34ad5a8a-87cb-4a7a-886d-64438974201c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.532314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] The token cache is being invalidate because project 91dff1d14c524857a3da34475b2f8ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:21.532702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.533568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.535417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 929/1859] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:21 2022] DELETE /identity/v3/projects/91dff1d14c524857a3da34475b2f8ec0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:21.539203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:21.540904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:21.565527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8d5d2-8c5a-4eb6-a24b-5b237954ceed None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:21.638559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:21.640041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:21.640500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:21.641085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:21.643339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:21.646569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad5a8a-87cb-4a7a-886d-64438974201c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:21.652479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:21.653265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:21.653652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:21.653990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] PATH_INFO: `/v3/users/abdf893d87c24f51ad6acbca256c553a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:21.655358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abdf893d87c24f51ad6acbca256c553a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:21.657451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:21.659234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:21.661148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:21.669166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:21.678820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 931/1860] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:21.740194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abdf893d87c24f51ad6acbca256c553a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.762994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abdf893d87c24f51ad6acbca256c553a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.784441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abdf893d87c24f51ad6acbca256c553a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.785985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abdf893d87c24f51ad6acbca256c553a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.787231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-814e4f42-19b1-47ac-8230-caf1c6aa5fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abdf893d87c24f51ad6acbca256c553a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:21.812004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 930/1861] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:21 2022] DELETE /identity/v3/users/abdf893d87c24f51ad6acbca256c553a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:21.912085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:21.913728 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:21.930123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b29a-8cde-4759-83fe-4b4dff5f47ed service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:22.028995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:22.029930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:22.030225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:22.030536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] PATH_INFO: `/v3/users/0233881acee2434b80baf49be6342874` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:22.032031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0233881acee2434b80baf49be6342874)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:22.034054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:22.105103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0233881acee2434b80baf49be6342874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:22.115081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0233881acee2434b80baf49be6342874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:22.115815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0233881acee2434b80baf49be6342874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:22.116531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0233881acee2434b80baf49be6342874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:22.126128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0233881acee2434b80baf49be6342874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:22.153099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 932/1862] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:21 2022] DELETE /identity/v3/users/0233881acee2434b80baf49be6342874 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:22.157448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:22.157742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:22.158589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:22.183542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:22.184833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:22.208807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:22.298800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 931/1863] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:22.356925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:22.358817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:22.483593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83969d5-77ca-44cb-b950-74153b297499 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:22.490055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:22.491730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:22.492120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:22.492503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:22.506620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:22.509589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:22.530168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 933/1864] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:22.961401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:22.963297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:22.977011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d982fa-08da-4f9c-95b4-7d1e511689ee None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:22.984654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:22.985250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:22.985537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:22.986009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] PATH_INFO: `/v3/projects/0f78e81bd91e46b3afaab82388e53a8c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:22.987571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f78e81bd91e46b3afaab82388e53a8c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:22.990757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:23.040975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:23.042314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.079335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59d6d-2e65-4f89-b7b0-4e3e7de0396c service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:23.086502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f78e81bd91e46b3afaab82388e53a8c', 'request_id': 'req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.105015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f78e81bd91e46b3afaab82388e53a8c', 'request_id': 'req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.121873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f78e81bd91e46b3afaab82388e53a8c', 'request_id': 'req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.127296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:23.153096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] The token cache is being invalidate because project 0f78e81bd91e46b3afaab82388e53a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:23.153601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.154845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-88dcd59a-06a8-483c-bd4b-7d98a02c8d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.157571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 932/1865] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:22 2022] DELETE /identity/v3/projects/0f78e81bd91e46b3afaab82388e53a8c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:23.163276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.163650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.164005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.192442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:23.194246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.204180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:23.205341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.205782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.207446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] PATH_INFO: `/v3/projects/8f73c520d76e444dbcc5ea193ca42b6e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.209808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f73c520d76e444dbcc5ea193ca42b6e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:23.213228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:23.280266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 933/1866] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:23.281033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:23.282549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.294019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f73c520d76e444dbcc5ea193ca42b6e', 'request_id': 'req-08125764-8f64-4205-8ec7-70c9e2214b06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.301453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34526c8b-5fdf-41a1-9d27-5d305907ec1d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:23.303596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f73c520d76e444dbcc5ea193ca42b6e', 'request_id': 'req-08125764-8f64-4205-8ec7-70c9e2214b06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.316938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f73c520d76e444dbcc5ea193ca42b6e', 'request_id': 'req-08125764-8f64-4205-8ec7-70c9e2214b06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.333681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] The token cache is being invalidate because project 8f73c520d76e444dbcc5ea193ca42b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:23.333992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.334734 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-08125764-8f64-4205-8ec7-70c9e2214b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.341188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 934/1867] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:23 2022] DELETE /identity/v3/projects/8f73c520d76e444dbcc5ea193ca42b6e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:23.341188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.341188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.341188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.361907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:23.375048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:23.376621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.379899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:23.380642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.380999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.381348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] PATH_INFO: `/v3/projects/43a1dbd2e6dc401ca03ec500b3c81633` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.382671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43a1dbd2e6dc401ca03ec500b3c81633)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:23.385053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:23.386824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 935/1868] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:23.388442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:23.391458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.404884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989497-25f8-4f64-b3c9-b21dac760f98 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:23.410317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:23.411383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.412334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.412658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] PATH_INFO: `/v3/users/bcb9108a6dfd416eb1973088a69c4bc8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.413901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb9108a6dfd416eb1973088a69c4bc8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:23.418207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:23.457994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43a1dbd2e6dc401ca03ec500b3c81633', 'request_id': 'req-30689780-310c-46f6-8e96-1806fa41f447'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.467464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43a1dbd2e6dc401ca03ec500b3c81633', 'request_id': 'req-30689780-310c-46f6-8e96-1806fa41f447'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.490639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43a1dbd2e6dc401ca03ec500b3c81633', 'request_id': 'req-30689780-310c-46f6-8e96-1806fa41f447'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.498315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb9108a6dfd416eb1973088a69c4bc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.508963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb9108a6dfd416eb1973088a69c4bc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.509799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb9108a6dfd416eb1973088a69c4bc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.510468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb9108a6dfd416eb1973088a69c4bc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.519166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb9108a6dfd416eb1973088a69c4bc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.519805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] The token cache is being invalidate because project 43a1dbd2e6dc401ca03ec500b3c81633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:23.520102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.520768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.522427 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 934/1869] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:23 2022] DELETE /identity/v3/projects/43a1dbd2e6dc401ca03ec500b3c81633 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:23.523293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:23.525576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.544228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 936/1870] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:23 2022] DELETE /identity/v3/users/bcb9108a6dfd416eb1973088a69c4bc8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:23.544228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:23.548797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.582921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:23.612022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30689780-310c-46f6-8e96-1806fa41f447 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:23.643696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d010e-08c2-4b16-b169-caaa31c931ca admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:23.651112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:23.651838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.652131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.652413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] PATH_INFO: `/v3/users/dde9f5a607514182a89c718db1b9cc03` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.653753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde9f5a607514182a89c718db1b9cc03)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:23.656567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:23.702832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:23.703816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.704208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.704492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.706049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:23.706049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:23.707454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:23.724041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 935/1871] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:23.731256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:23.746153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2ac8c-e767-49dd-afe4-2191c5556315 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:23.751477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde9f5a607514182a89c718db1b9cc03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.751866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:23.752647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:23.752984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:23.753236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:23.754061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:23.757390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:23.762111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde9f5a607514182a89c718db1b9cc03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.763230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde9f5a607514182a89c718db1b9cc03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.764371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde9f5a607514182a89c718db1b9cc03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.779539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde9f5a607514182a89c718db1b9cc03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:23.805211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:23.839206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 936/1872] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:23 2022] POST /identity/v3/projects => generated 408 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:23.844504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:23.845151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 937/1873] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:23 2022] DELETE /identity/v3/users/dde9f5a607514182a89c718db1b9cc03 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:23.847668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:23.955859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004f5cd-fc30-4960-98e9-7c0c33459fb2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.043929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.044623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.044623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.044970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.046628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.048737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.084387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 937/1874] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:23 2022] POST /identity/v3/users => generated 305 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:24.089010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.100589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dca61-0959-48d9-a6d0-3fa723ff1487 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.104241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.107279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:24.108069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.110791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.111140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.111485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.113467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.117966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.134970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1289-112f-4132-a9e8-1811b4efd155 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.143076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 938/1875] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:24 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:24.146746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.151034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.151926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.152391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.152734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] PATH_INFO: `/v3/projects/f04dec27ec034c9bb24be088ed76b911` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.154870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04dec27ec034c9bb24be088ed76b911)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.159509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.174501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c204f-602f-4f1a-b056-b57166c3712b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.189735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.190963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.191441 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.193028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.193804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.195487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.214305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 939/1876] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:24 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:24.219079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.236613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214385a5-8f81-4d7f-91db-f427eecbffef admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.247548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04dec27ec034c9bb24be088ed76b911', 'request_id': 'req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:24.256765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04dec27ec034c9bb24be088ed76b911', 'request_id': 'req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:24.276135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04dec27ec034c9bb24be088ed76b911', 'request_id': 'req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:24.329554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] The token cache is being invalidate because project f04dec27ec034c9bb24be088ed76b911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:24.330153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:24.331608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5e7d0168-b674-4295-a35d-2c6f9dcd8b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:24.334620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5952d-65b6-41d0-b29a-686a8b085825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.335912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 938/1877] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:24 2022] DELETE /identity/v3/projects/f04dec27ec034c9bb24be088ed76b911 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:24.336080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5952d-65b6-41d0-b29a-686a8b085825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.336497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5952d-65b6-41d0-b29a-686a8b085825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.337458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5952d-65b6-41d0-b29a-686a8b085825 admin admin] PATH_INFO: `/v3/projects/380080c2362b48b8a521dbf5d198102c/users/69bc63dedcd54f9d9d52bb66814d6712/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.343281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22300192-6df6-4a02-9e3e-1af4fcc6e548 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.343569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22300192-6df6-4a02-9e3e-1af4fcc6e548 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.343955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22300192-6df6-4a02-9e3e-1af4fcc6e548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.363144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5952d-65b6-41d0-b29a-686a8b085825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380080c2362b48b8a521dbf5d198102c, user_id=69bc63dedcd54f9d9d52bb66814d6712, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.368343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5952d-65b6-41d0-b29a-686a8b085825 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.369538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-22300192-6df6-4a02-9e3e-1af4fcc6e548 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:24.371066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-22300192-6df6-4a02-9e3e-1af4fcc6e548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:24.380916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:24.381767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 939/1878] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:24.389070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 940/1879] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:24 2022] PUT /identity/v3/projects/380080c2362b48b8a521dbf5d198102c/users/69bc63dedcd54f9d9d52bb66814d6712/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:24.390410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6576cc5-27cc-409a-96f5-035d088a877b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.390758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6576cc5-27cc-409a-96f5-035d088a877b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.391177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6576cc5-27cc-409a-96f5-035d088a877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.400699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.403595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.404071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.416870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d6576cc5-27cc-409a-96f5-035d088a877b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:24.417961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d6576cc5-27cc-409a-96f5-035d088a877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:24.423907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:24.472675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] MFA Rules not processed for user `69bc63dedcd54f9d9d52bb66814d6712`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:24.474971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:24.505098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 940/1880] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:24.506412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6576cc5-27cc-409a-96f5-035d088a877b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.538407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6576cc5-27cc-409a-96f5-035d088a877b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.553404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.554016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.554340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.554632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.555388 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:24.555743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.557407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.590868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 941/1881] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:24.594305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.616051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf320dcf-7cfc-4656-8a84-6dd8eb0b0da9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.630291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.633062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.635320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.636737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.639154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.646036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.658832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 941/1882] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:24.666945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.669866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:24.693024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e369-ef7c-45ed-a28d-8a6e98c49eec None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.695199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 942/1883] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:24 2022] POST /identity/v3/projects => generated 360 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:24.700829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.851242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.852322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.852885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.854171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.854364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.857521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.860146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f78d5-1ecb-4485-8862-1870b423ba31 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:24.867648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:24.868574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:24.868934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:24.869443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:24.870980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:24.873267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:24.929404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 942/1884] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:24 2022] POST /identity/v3/projects => generated 410 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:24.931470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 943/1885] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:24 2022] POST /identity/v3/users => generated 281 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:24.932526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.933750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:24.935458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:24.965873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf375-35eb-4981-a3c1-9f4442e94c95 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.153674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5fa7-a882-42e9-be7f-7c0c34827e7d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.166660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.167669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.168149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.168728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.169526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] PATH_INFO: `/v3/projects/a2c16bbe704f4774b4877da670957bde` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.171626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c16bbe704f4774b4877da670957bde)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.175056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.175354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.175662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.176360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.176763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.183595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.206629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:25.248139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:25.250056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 944/1886] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:24 2022] POST /identity/v3/users => generated 312 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:25.251281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.271755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed8ec-ddf1-4646-b467-35037b1bcce0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.286121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.287165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.287845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.288282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.289169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.291713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.307196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 945/1887] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:25 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:25.308188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.318930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04dbd-f669-4b67-8e94-f0dc8e785ba3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.336217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c16bbe704f4774b4877da670957bde', 'request_id': 'req-5b945832-18c0-4343-bbbe-ce152fcd55d9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:25.346625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c16bbe704f4774b4877da670957bde', 'request_id': 'req-5b945832-18c0-4343-bbbe-ce152fcd55d9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:25.364639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c16bbe704f4774b4877da670957bde', 'request_id': 'req-5b945832-18c0-4343-bbbe-ce152fcd55d9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:25.384275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] The token cache is being invalidate because project a2c16bbe704f4774b4877da670957bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:25.384665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:25.385847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:25.390533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 943/1888] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:24 2022] DELETE /identity/v3/projects/a2c16bbe704f4774b4877da670957bde => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:25.393065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.396010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:25.494394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c4470-2b67-4df0-9679-83dbb6b71466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.495234 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c4470-2b67-4df0-9679-83dbb6b71466 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.495618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c4470-2b67-4df0-9679-83dbb6b71466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.496014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c4470-2b67-4df0-9679-83dbb6b71466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.497242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c4470-2b67-4df0-9679-83dbb6b71466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.501801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c4470-2b67-4df0-9679-83dbb6b71466 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.527729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 946/1889] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:25 2022] GET /identity/v3/roles => generated 1427 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:25.531231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edcde8-4864-4819-8f14-d8c6638422cb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.531885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edcde8-4864-4819-8f14-d8c6638422cb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.532320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945832-18c0-4343-bbbe-ce152fcd55d9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.532628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edcde8-4864-4819-8f14-d8c6638422cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.541250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.542149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.542614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.543072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.543927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.553290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.563662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-17edcde8-4864-4819-8f14-d8c6638422cb None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:25.565255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-17edcde8-4864-4819-8f14-d8c6638422cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:25.567420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 944/1890] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:25 2022] GET /identity/v3/roles => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:25.568452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.573157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:25.581081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 947/1891] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:25.583246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edcde8-4864-4819-8f14-d8c6638422cb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.600744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718953e-82f5-481e-b3a0-0c1727e376d7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.605735 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edcde8-4864-4819-8f14-d8c6638422cb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.608938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3abadb-930e-4ed2-a829-d68174b26f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.610041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3abadb-930e-4ed2-a829-d68174b26f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.610557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3abadb-930e-4ed2-a829-d68174b26f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.610946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3abadb-930e-4ed2-a829-d68174b26f5a admin admin] PATH_INFO: `/v3/projects/ceaa3fb1676646cba0a0671ae1cb9458/users/b9fc5c9147144c03a18c44fcf1afb045/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.612414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2459599-61d8-4874-b655-7d2b973c2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.613884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459599-61d8-4874-b655-7d2b973c2dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.614382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459599-61d8-4874-b655-7d2b973c2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.614812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2459599-61d8-4874-b655-7d2b973c2dcb admin admin] PATH_INFO: `/v3/projects/a7ece208a9cb4eabb2ee9706cc56be37/users/ab614b458a084310ae16f6eb18ab469c/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.636159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2459599-61d8-4874-b655-7d2b973c2dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ece208a9cb4eabb2ee9706cc56be37, user_id=ab614b458a084310ae16f6eb18ab469c, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.637208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3abadb-930e-4ed2-a829-d68174b26f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceaa3fb1676646cba0a0671ae1cb9458, user_id=b9fc5c9147144c03a18c44fcf1afb045, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.640254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2459599-61d8-4874-b655-7d2b973c2dcb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.656799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3abadb-930e-4ed2-a829-d68174b26f5a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.660864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 948/1892] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:25 2022] PUT /identity/v3/projects/a7ece208a9cb4eabb2ee9706cc56be37/users/ab614b458a084310ae16f6eb18ab469c/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:25.662982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2953e-d9ef-47dc-9304-b98656e4b027 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.663430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2953e-d9ef-47dc-9304-b98656e4b027 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.664101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2953e-d9ef-47dc-9304-b98656e4b027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.691054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 945/1893] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:25 2022] PUT /identity/v3/projects/ceaa3fb1676646cba0a0671ae1cb9458/users/b9fc5c9147144c03a18c44fcf1afb045/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:25.692505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ae7e-d516-4054-88d5-cc2ccf2dedf1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.692923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ae7e-d516-4054-88d5-cc2ccf2dedf1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.693273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ae7e-d516-4054-88d5-cc2ccf2dedf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.694501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dbb2953e-d9ef-47dc-9304-b98656e4b027 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:25.696636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dbb2953e-d9ef-47dc-9304-b98656e4b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:25.773126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3180ae7e-d516-4054-88d5-cc2ccf2dedf1 None None] MFA Rules not processed for user `ab614b458a084310ae16f6eb18ab469c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:25.775928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3180ae7e-d516-4054-88d5-cc2ccf2dedf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:25.822435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 949/1894] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:25.823488 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2953e-d9ef-47dc-9304-b98656e4b027 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.848100 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2953e-d9ef-47dc-9304-b98656e4b027 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.860791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.861516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.861740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.862006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.862760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.865658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.901795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 950/1895] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:25 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:25.902770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.936109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afce25d-b442-4c6e-82eb-7185b7a4ae29 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:25.952240 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:25.952983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:25.953401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:25.953551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:25.954296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:25.954599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:25.956235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:25.972526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 946/1896] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:25.974032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ae7e-d516-4054-88d5-cc2ccf2dedf1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:25.983552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 951/1897] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:25.991829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.006285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:26.014383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ae7e-d516-4054-88d5-cc2ccf2dedf1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.014551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab93822-1386-4033-b2b6-b53a08e4570a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.021743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.022955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.023251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.023538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] PATH_INFO: `/v3/projects/ceaa3fb1676646cba0a0671ae1cb9458/users/b9fc5c9147144c03a18c44fcf1afb045/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.028661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceaa3fb1676646cba0a0671ae1cb9458, user_id=b9fc5c9147144c03a18c44fcf1afb045, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.028985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2557e16-3b65-4645-a378-0620ecaa13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.029643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557e16-3b65-4645-a378-0620ecaa13c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.030018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557e16-3b65-4645-a378-0620ecaa13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.031337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557e16-3b65-4645-a378-0620ecaa13c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.032029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2557e16-3b65-4645-a378-0620ecaa13c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.035651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2557e16-3b65-4645-a378-0620ecaa13c2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.038486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.059492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 947/1898] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:25 2022] PUT /identity/v3/projects/ceaa3fb1676646cba0a0671ae1cb9458/users/b9fc5c9147144c03a18c44fcf1afb045/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:26.071309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.073458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:26.102184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 952/1899] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:25 2022] POST /identity/v3/projects => generated 392 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:26.104932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f9386-9219-491b-9e93-20354cd2585f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.105599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f9386-9219-491b-9e93-20354cd2585f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.105737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f9386-9219-491b-9e93-20354cd2585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.121471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:26.170620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e76f9386-9219-491b-9e93-20354cd2585f None None] MFA Rules not processed for user `b9fc5c9147144c03a18c44fcf1afb045`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:26.172902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e76f9386-9219-491b-9e93-20354cd2585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:26.179427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a1ad2-d5c5-4dc3-b5a4-4d7e975fb483 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.307832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.309654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.310726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.311241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.316081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 953/1900] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:26 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:26.316081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f9386-9219-491b-9e93-20354cd2585f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.415714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f9386-9219-491b-9e93-20354cd2585f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.421999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.422784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.423074 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.423359 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.424640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.427350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.428330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.430204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.459829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 948/1901] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:26.461029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.462229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 954/1902] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:26 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:26.463353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.467968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:26.478882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a657f-3da8-4e28-8e32-442759f333f8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.486645 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fdcbb-5094-4001-a95d-dac312fcfaf5 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.493695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.494538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.494923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.495332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.498567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.499233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.499518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.499796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] PATH_INFO: `/v3/users/ab614b458a084310ae16f6eb18ab469c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.500984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab614b458a084310ae16f6eb18ab469c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.503049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.507717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.509704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.521213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 949/1903] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:26 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:26.530306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.534878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea065a-db49-45da-b9cc-ea11997e55e5 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.541049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.542530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.542530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.542874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.544181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.545955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.579585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 950/1904] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:26 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:26.593345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.627373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb613dfc-b05f-4573-9a37-326378283fc0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.627610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab614b458a084310ae16f6eb18ab469c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:26.635232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.636340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.637289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.637674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.638768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab614b458a084310ae16f6eb18ab469c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:26.638958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.641371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.654625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:26.656495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab614b458a084310ae16f6eb18ab469c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:26.657748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab614b458a084310ae16f6eb18ab469c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:26.658907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-323f99b1-8ecf-45ad-ad70-ce5744f9eee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab614b458a084310ae16f6eb18ab469c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:26.663316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 951/1905] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:26 2022] GET /identity/v3/roles => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:26.664918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.667772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:26.681116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 955/1906] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:26 2022] DELETE /identity/v3/users/ab614b458a084310ae16f6eb18ab469c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:26.683673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb07ea1-f8cb-4c01-9288-4ca9b80cc970 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.686663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.686964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.687252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.709302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:26.710754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:26.720713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:26.774890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.776326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.777005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.777788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] PATH_INFO: `/v3/projects/9295846097694c2d94472dc8c9570a1d/users/4dfc84cbf0b4459db05892fb55bb6c1c/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:26.800435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 956/1907] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:26.801524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.803040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:26.807105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9295846097694c2d94472dc8c9570a1d, user_id=4dfc84cbf0b4459db05892fb55bb6c1c, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:26.815321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:26.849166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 952/1908] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:26 2022] PUT /identity/v3/projects/9295846097694c2d94472dc8c9570a1d/users/4dfc84cbf0b4459db05892fb55bb6c1c/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:26.849166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:26.849166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:26.902114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa265d-0284-45b7-915f-6b56e4d022fe None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.965637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a5125-aef5-4406-bb11-a25f372479bd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:26.970082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751436e-b2bb-436e-b2b3-1bc829a72065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:26.971071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751436e-b2bb-436e-b2b3-1bc829a72065 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:26.971478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751436e-b2bb-436e-b2b3-1bc829a72065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:26.971799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751436e-b2bb-436e-b2b3-1bc829a72065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.017990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.018702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.018993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.019974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.023094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:27.080214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751436e-b2bb-436e-b2b3-1bc829a72065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.081855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751436e-b2bb-436e-b2b3-1bc829a72065 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.094782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 953/1909] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:27.096390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99241-a3c4-4f42-9b36-a0ff02db7b6b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.096743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99241-a3c4-4f42-9b36-a0ff02db7b6b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.097120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e99241-a3c4-4f42-9b36-a0ff02db7b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.140304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-55e99241-a3c4-4f42-9b36-a0ff02db7b6b None None] MFA Rules not processed for user `4dfc84cbf0b4459db05892fb55bb6c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:27.141565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-55e99241-a3c4-4f42-9b36-a0ff02db7b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:27.168281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.181867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.188911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:27.198520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 957/1910] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:26 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:27.201085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:27.235625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 954/1911] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:27.240467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.256158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2d61-3887-4aa5-90d5-e3eb0eda440e service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.262433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.263085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.263368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.263921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.264392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.267245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.313510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 958/1912] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:27 2022] POST /identity/v3/projects => generated 394 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:27.314844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99241-a3c4-4f42-9b36-a0ff02db7b6b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.337674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e99241-a3c4-4f42-9b36-a0ff02db7b6b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.457047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.457700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.457989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.458288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.458995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.460946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.492523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 955/1913] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:27 2022] POST /identity/v3/users => generated 304 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:27.497294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.512424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43040d8-23fc-425d-90fe-3057b6938a44 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.524993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.524993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.524993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.525529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.528396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.534298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.558703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 959/1914] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:27 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:27.563276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.590890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a352f-427d-4007-95da-9c11b33fa5b4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.604724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.605494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.605853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.606217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] PATH_INFO: `/v3/projects/9f5e205f41314f45a10e6cf2b3cb6ff1/users/dd45de1c69f24db38fbd9f66d47a0c6e/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.617216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.626184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:27.646987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e205f41314f45a10e6cf2b3cb6ff1, user_id=dd45de1c69f24db38fbd9f66d47a0c6e, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.651860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.661057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614ed8a-59e8-4090-bc64-e6920d476eb5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.668786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.669758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.670461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.671003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] PATH_INFO: `/v3/projects/a7ece208a9cb4eabb2ee9706cc56be37` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.672371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ece208a9cb4eabb2ee9706cc56be37)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.673009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 956/1915] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:27 2022] PUT /identity/v3/projects/9f5e205f41314f45a10e6cf2b3cb6ff1/users/dd45de1c69f24db38fbd9f66d47a0c6e/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:27.675600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.676946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.758388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf96d7f-8db0-4c46-8b45-3e81e670a088 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.768997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ece208a9cb4eabb2ee9706cc56be37', 'request_id': 'req-caca547b-20a7-4757-b458-cd02f385366d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:27.777600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ece208a9cb4eabb2ee9706cc56be37', 'request_id': 'req-caca547b-20a7-4757-b458-cd02f385366d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:27.787443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ece208a9cb4eabb2ee9706cc56be37', 'request_id': 'req-caca547b-20a7-4757-b458-cd02f385366d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:27.807812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] The token cache is being invalidate because project a7ece208a9cb4eabb2ee9706cc56be37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:27.808119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:27.810516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-caca547b-20a7-4757-b458-cd02f385366d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:27.812631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 960/1916] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:27 2022] DELETE /identity/v3/projects/a7ece208a9cb4eabb2ee9706cc56be37 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:27.818201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55281b4-6f68-4125-8bb6-ecbb9e37eeb7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.818529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55281b4-6f68-4125-8bb6-ecbb9e37eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.818809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55281b4-6f68-4125-8bb6-ecbb9e37eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.830282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.831091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.831492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.831868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.832680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.834436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.838013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:27.840528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f55281b4-6f68-4125-8bb6-ecbb9e37eeb7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:27.841829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f55281b4-6f68-4125-8bb6-ecbb9e37eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:27.849551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 957/1917] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:27 2022] GET /identity/v3/roles => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:27.850932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 961/1918] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:27.854202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.856101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:27.860245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209b5a2-88c9-4986-a011-babb8947d8cd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.860652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209b5a2-88c9-4986-a011-babb8947d8cd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.861034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209b5a2-88c9-4986-a011-babb8947d8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.869429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f4beb-bf39-4f5c-9a17-5b0ea6922572 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.875182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8567736-9d75-4eb6-8213-9347e2808cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.875868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8567736-9d75-4eb6-8213-9347e2808cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.876155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8567736-9d75-4eb6-8213-9347e2808cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.876468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8567736-9d75-4eb6-8213-9347e2808cdf admin admin] PATH_INFO: `/v3/projects/9f5e205f41314f45a10e6cf2b3cb6ff1/users/dd45de1c69f24db38fbd9f66d47a0c6e/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.878492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8567736-9d75-4eb6-8213-9347e2808cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e205f41314f45a10e6cf2b3cb6ff1, user_id=dd45de1c69f24db38fbd9f66d47a0c6e, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.881357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8567736-9d75-4eb6-8213-9347e2808cdf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:27.888392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0209b5a2-88c9-4986-a011-babb8947d8cd None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:27.890025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0209b5a2-88c9-4986-a011-babb8947d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:27.896534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 958/1919] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:27 2022] PUT /identity/v3/projects/9f5e205f41314f45a10e6cf2b3cb6ff1/users/dd45de1c69f24db38fbd9f66d47a0c6e/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:27.908182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.908468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.908750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.942206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] MFA Rules not processed for user `dd45de1c69f24db38fbd9f66d47a0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:27.943906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:27.966958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 962/1920] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:27.970685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209b5a2-88c9-4986-a011-babb8947d8cd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:27.981290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209b5a2-88c9-4986-a011-babb8947d8cd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:27.986143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:27.986892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:27.987181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:27.987459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:27.988169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:27.988482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:27.990108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.003173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 963/1921] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:04:28.007553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.020988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751c6e-9f5e-46ac-94a7-8d004435b6b7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.027675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.028433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.028800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.029174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.029934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.031567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 959/1922] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:28.032069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.043864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.045389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:28.090652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 964/1923] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:28 2022] POST /identity/v3/projects => generated 374 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:28.091818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.127353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:28.173661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd0fa5-84ed-46e0-90c6-edca265b1d99 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.217771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba40d9-2230-4e90-ba3c-f28c77d1bb4e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.239071 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.239776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.240079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.240369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.241045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.243141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.273576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289726c-1f7e-4de6-84c8-23f47dc02703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.285823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289726c-1f7e-4de6-84c8-23f47dc02703 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.286542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289726c-1f7e-4de6-84c8-23f47dc02703 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.286961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289726c-1f7e-4de6-84c8-23f47dc02703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.303279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 965/1924] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:28 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:28.305331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.327311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec07d0f-a720-4fe4-abf2-56269f01d854 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.342591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:28.346860 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.347665 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.348192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.348313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.349379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.351390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.365331 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 966/1925] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:28 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:28.370114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.388992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed5f7-d8c0-4de8-a870-e935a15d5065 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.394490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.395221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.395718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.396125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.396882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.398520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.411133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289726c-1f7e-4de6-84c8-23f47dc02703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.412588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289726c-1f7e-4de6-84c8-23f47dc02703 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.416143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 967/1926] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:28 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:28.417547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.429859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cc89f-0117-44cb-aeaa-f01ab03ffdbb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.434246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 960/1927] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:28.437176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.438131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.438529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.438916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] PATH_INFO: `/v3/projects/70603abcabac4d4f81d2e38ad26f05b6/users/3c9ed488ac684c3da17e4790476f979e/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.464690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70603abcabac4d4f81d2e38ad26f05b6, user_id=3c9ed488ac684c3da17e4790476f979e, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.469871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.499328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 968/1928] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:28 2022] PUT /identity/v3/projects/70603abcabac4d4f81d2e38ad26f05b6/users/3c9ed488ac684c3da17e4790476f979e/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:28.504754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.504754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.504931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.558825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.562055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:28.563790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:28.697476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b837f-1b1d-49dd-8e99-edb93e2c0360 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.707885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cb7f9-e552-4380-990c-f601db8559a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.717048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 961/1929] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:28.720220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb7f9-e552-4380-990c-f601db8559a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.720634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb7f9-e552-4380-990c-f601db8559a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.721465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb7f9-e552-4380-990c-f601db8559a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.724495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-013cb7f9-e552-4380-990c-f601db8559a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:28.737721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:28.739306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:28.867270 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cb7f9-e552-4380-990c-f601db8559a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.868773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cb7f9-e552-4380-990c-f601db8559a1 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.879135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 969/1930] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:28.919915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a51de8-191f-466a-885c-da0ff1d27cf3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:28.932059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:28.933552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:28.934913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:28.936879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:28.969755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:28.971381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:28.999844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 962/1931] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:30.020268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1db64-b8ee-4494-9859-1d8c9327ab95 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:30.020832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1db64-b8ee-4494-9859-1d8c9327ab95 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:30.020832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1db64-b8ee-4494-9859-1d8c9327ab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:30.035642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:30.054437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f3b1db64-b8ee-4494-9859-1d8c9327ab95 None None] MFA Rules not processed for user `3c9ed488ac684c3da17e4790476f979e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:30.056281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f3b1db64-b8ee-4494-9859-1d8c9327ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:30.141987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 970/1932] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:30.152674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:30.154251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:30.166785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df12ab3-84a9-46a1-8c04-e0848ea30f0c service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:30.170385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:30.171007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:30.171292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:30.171569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:30.179990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:30.182193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:30.192472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 963/1933] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:31.801615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035e50f-38a9-41e7-ad64-14f17e3d2e9e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:31.802186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035e50f-38a9-41e7-ad64-14f17e3d2e9e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:31.802571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035e50f-38a9-41e7-ad64-14f17e3d2e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:31.832273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2035e50f-38a9-41e7-ad64-14f17e3d2e9e None None] MFA Rules not processed for user `3c9ed488ac684c3da17e4790476f979e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:31.834336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2035e50f-38a9-41e7-ad64-14f17e3d2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:31.846748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 971/1934] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:33.467510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:33.482185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12db0e-0c92-4ac9-9842-017e14714385 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:33.486947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:33.487605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:33.487892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:33.488170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] PATH_INFO: `/v3/users/4dfc84cbf0b4459db05892fb55bb6c1c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:33.489353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfc84cbf0b4459db05892fb55bb6c1c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:33.491343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:33.545985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfc84cbf0b4459db05892fb55bb6c1c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.555421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfc84cbf0b4459db05892fb55bb6c1c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.555421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfc84cbf0b4459db05892fb55bb6c1c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.555421 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfc84cbf0b4459db05892fb55bb6c1c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.558817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:33.579852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfc84cbf0b4459db05892fb55bb6c1c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.635538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 964/1935] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:33 2022] DELETE /identity/v3/users/4dfc84cbf0b4459db05892fb55bb6c1c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:33.639834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:33.640318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:33.640759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:33.667399 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:33.668938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:33.761583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 972/1936] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:33.768457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:33.769866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:33.770149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:33.772065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:33.788223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35668d-f055-4b7e-8bb1-edca253fc39a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:33.793685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:33.794456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:33.794873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:33.795221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] PATH_INFO: `/v3/users/69bc63dedcd54f9d9d52bb66814d6712` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:33.796475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bc63dedcd54f9d9d52bb66814d6712)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:33.798504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:33.854205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2985c4a-8212-41c8-b713-4f1c39c033f0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:33.859302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce78364-2c2b-4178-9723-f4bb15ea2889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:33.859937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce78364-2c2b-4178-9723-f4bb15ea2889 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:33.860219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce78364-2c2b-4178-9723-f4bb15ea2889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:33.860492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce78364-2c2b-4178-9723-f4bb15ea2889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:33.867655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bc63dedcd54f9d9d52bb66814d6712'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.870846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce78364-2c2b-4178-9723-f4bb15ea2889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:33.872406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce78364-2c2b-4178-9723-f4bb15ea2889 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:33.877901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bc63dedcd54f9d9d52bb66814d6712'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.897331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 965/1937] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:33.901258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bc63dedcd54f9d9d52bb66814d6712'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.902539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bc63dedcd54f9d9d52bb66814d6712'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.903322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bc63dedcd54f9d9d52bb66814d6712'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:33.919685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 973/1938] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:33 2022] DELETE /identity/v3/users/69bc63dedcd54f9d9d52bb66814d6712 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:33.925332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:33.925796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:33.926097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:33.945465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:33.947564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:34.047289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 966/1939] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:34.067772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:34.069070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:34.077840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:34.222603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f49c7-839c-4a6d-b790-4e6ad0d72896 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:34.227509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:34.228481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:34.228842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:34.229570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:34.243418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:34.245422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:34.266293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 974/1940] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:34.327298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:34.328863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:34.348056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16c589-cffe-4fb2-9f9e-76299b0defc4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:34.364280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:34.365201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:34.366112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:34.366112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] PATH_INFO: `/v3/projects/9295846097694c2d94472dc8c9570a1d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:34.371478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9295846097694c2d94472dc8c9570a1d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:34.374314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:34.466745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9295846097694c2d94472dc8c9570a1d', 'request_id': 'req-a0f54a13-d8e0-4016-8f18-16c9b29cd044'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.476355 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9295846097694c2d94472dc8c9570a1d', 'request_id': 'req-a0f54a13-d8e0-4016-8f18-16c9b29cd044'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.491937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9295846097694c2d94472dc8c9570a1d', 'request_id': 'req-a0f54a13-d8e0-4016-8f18-16c9b29cd044'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.534017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] The token cache is being invalidate because project 9295846097694c2d94472dc8c9570a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:34.534444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.535681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.543911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 967/1941] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:34 2022] DELETE /identity/v3/projects/9295846097694c2d94472dc8c9570a1d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:34.545832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:34.560188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c38129-c9e2-4c82-82d0-7060462a045c service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:34.684696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:34.685698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:34.685698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:34.686355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] PATH_INFO: `/v3/users/dd45de1c69f24db38fbd9f66d47a0c6e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:34.690111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd45de1c69f24db38fbd9f66d47a0c6e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:34.692111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:34.846877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd45de1c69f24db38fbd9f66d47a0c6e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.859038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd45de1c69f24db38fbd9f66d47a0c6e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.902148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd45de1c69f24db38fbd9f66d47a0c6e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.903515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd45de1c69f24db38fbd9f66d47a0c6e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.904365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd45de1c69f24db38fbd9f66d47a0c6e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:34.923112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:34.924771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:34.944493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 975/1942] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:34 2022] DELETE /identity/v3/users/dd45de1c69f24db38fbd9f66d47a0c6e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:34.949293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:34.957538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f54a13-d8e0-4016-8f18-16c9b29cd044 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:35.068850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:35.069495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:35.069825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:35.070115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] PATH_INFO: `/v3/projects/380080c2362b48b8a521dbf5d198102c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:35.071793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] RBAC: Authorizing `identity:delete_project(project_id=380080c2362b48b8a521dbf5d198102c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:35.074302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:35.152653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380080c2362b48b8a521dbf5d198102c', 'request_id': 'req-70ccc095-fee1-41ec-a98f-4a27cad7800d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.159771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380080c2362b48b8a521dbf5d198102c', 'request_id': 'req-70ccc095-fee1-41ec-a98f-4a27cad7800d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.169136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380080c2362b48b8a521dbf5d198102c', 'request_id': 'req-70ccc095-fee1-41ec-a98f-4a27cad7800d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.184210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] The token cache is being invalidate because project 380080c2362b48b8a521dbf5d198102c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:35.184736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.185862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.188084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 968/1943] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:34 2022] DELETE /identity/v3/projects/380080c2362b48b8a521dbf5d198102c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:35.192089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:35.193557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:35.208726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7860a-29ea-4fb6-8a86-1c81d91f0927 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:35.234424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:35.283035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:35.283711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:35.284374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:35.284374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] PATH_INFO: `/v3/users/b9fc5c9147144c03a18c44fcf1afb045` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:35.286075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9fc5c9147144c03a18c44fcf1afb045)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:35.288309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:35.335339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:35.341739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:35.380157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9fc5c9147144c03a18c44fcf1afb045'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.383885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccc095-fee1-41ec-a98f-4a27cad7800d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:35.389968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9fc5c9147144c03a18c44fcf1afb045'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.395234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:35.396661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:35.396858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:35.397144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] PATH_INFO: `/v3/projects/9f5e205f41314f45a10e6cf2b3cb6ff1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:35.398630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5e205f41314f45a10e6cf2b3cb6ff1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:35.400971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:35.407986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9fc5c9147144c03a18c44fcf1afb045'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.409295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9fc5c9147144c03a18c44fcf1afb045'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.409971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42512aeb-cf88-49b5-b875-170f8ee45592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9fc5c9147144c03a18c44fcf1afb045'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.444909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 976/1944] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:35 2022] DELETE /identity/v3/users/b9fc5c9147144c03a18c44fcf1afb045 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:35.462922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5e205f41314f45a10e6cf2b3cb6ff1', 'request_id': 'req-7f09074f-2291-4a16-993e-5567775cbe11'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.472310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5e205f41314f45a10e6cf2b3cb6ff1', 'request_id': 'req-7f09074f-2291-4a16-993e-5567775cbe11'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.484781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5e205f41314f45a10e6cf2b3cb6ff1', 'request_id': 'req-7f09074f-2291-4a16-993e-5567775cbe11'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.502844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] The token cache is being invalidate because project 9f5e205f41314f45a10e6cf2b3cb6ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:35.503184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.504034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f09074f-2291-4a16-993e-5567775cbe11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:35.506737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 969/1945] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:35 2022] DELETE /identity/v3/projects/9f5e205f41314f45a10e6cf2b3cb6ff1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:35.514522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde208-7e90-4dde-a5ba-cb7b2f999864 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:35.514863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde208-7e90-4dde-a5ba-cb7b2f999864 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:35.515146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fde208-7e90-4dde-a5ba-cb7b2f999864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:35.548635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-78fde208-7e90-4dde-a5ba-cb7b2f999864 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:35.550044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-78fde208-7e90-4dde-a5ba-cb7b2f999864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:35.639124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 977/1946] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:35.661783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4755-6aab-4269-ab5c-5d6b28273f60 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:35.662822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4755-6aab-4269-ab5c-5d6b28273f60 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:35.662822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4755-6aab-4269-ab5c-5d6b28273f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:35.723485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ba0d4755-6aab-4269-ab5c-5d6b28273f60 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:35.725842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ba0d4755-6aab-4269-ab5c-5d6b28273f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:35.752841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde208-7e90-4dde-a5ba-cb7b2f999864 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:35.756650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 970/1947] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:35.765576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fde208-7e90-4dde-a5ba-cb7b2f999864 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:35.786221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:35.787021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:35.787409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:35.787828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:35.788783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:35.789194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:35.792065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:35.811182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 978/1948] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:35.812258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4755-6aab-4269-ab5c-5d6b28273f60 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:35.825709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4755-6aab-4269-ab5c-5d6b28273f60 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:35.830938 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:35.831577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:35.831866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:35.832167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:35.832822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:35.835092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:35.845841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:35.884397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 971/1949] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:35 2022] POST /identity/v3/projects => generated 374 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:35.885252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:35.908690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc4b8-d277-457b-a1f4-a3e32acb0609 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:35.948787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:35.995587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:35.997925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:36.041577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.042243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.042566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.043088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.043802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.046317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.083303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 979/1950] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:35 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:36.084476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.120565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8c74-9fcc-4c43-9310-ef40d5505d7b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.127303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.127950 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.129312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.129949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.130732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.132464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.154935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 980/1951] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:36 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:36.156168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.160231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1841e-b3ca-4865-8eb1-f7ab7c45e550 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.171959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.175659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.176148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.176445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] PATH_INFO: `/v3/projects/ceaa3fb1676646cba0a0671ae1cb9458` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.177763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceaa3fb1676646cba0a0671ae1cb9458)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.179555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c167370-79b2-4cdb-a797-523427f0ac18 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.182639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.191986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.191986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.191986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.191986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.192609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.192609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.226938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 981/1952] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:36 2022] GET /identity/v3/roles => generated 1427 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:36.229939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.253705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c942dd-fd8a-485d-944e-4776ed46e4a1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.263766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305bd9e-372e-4dd5-8127-452de40b0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.264754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305bd9e-372e-4dd5-8127-452de40b0f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.265175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305bd9e-372e-4dd5-8127-452de40b0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.265544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305bd9e-372e-4dd5-8127-452de40b0f50 admin admin] PATH_INFO: `/v3/projects/1b71dc36a2944dd09002872cb1f8fc7b/users/7ee529bb6399487eba7c2d339584268f/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.291789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceaa3fb1676646cba0a0671ae1cb9458', 'request_id': 'req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:36.293752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305bd9e-372e-4dd5-8127-452de40b0f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b71dc36a2944dd09002872cb1f8fc7b, user_id=7ee529bb6399487eba7c2d339584268f, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.298937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305bd9e-372e-4dd5-8127-452de40b0f50 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.310863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceaa3fb1676646cba0a0671ae1cb9458', 'request_id': 'req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:36.318717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 982/1953] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:36 2022] PUT /identity/v3/projects/1b71dc36a2944dd09002872cb1f8fc7b/users/7ee529bb6399487eba7c2d339584268f/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:36.324714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.325399 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.325829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.335062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceaa3fb1676646cba0a0671ae1cb9458', 'request_id': 'req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:36.348642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] The token cache is being invalidate because project ceaa3fb1676646cba0a0671ae1cb9458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:36.348954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:36.349731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6755b9bc-b4b8-4e3f-bd5d-e18ec59b1dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:36.351928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 972/1954] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:35 2022] DELETE /identity/v3/projects/ceaa3fb1676646cba0a0671ae1cb9458 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:36.356368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a95-a49f-45c2-9884-c59ede6184ec None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.356663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a95-a49f-45c2-9884-c59ede6184ec None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.357103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a95-a49f-45c2-9884-c59ede6184ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.357273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:36.359265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:36.402334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b15b8a95-a49f-45c2-9884-c59ede6184ec None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:36.404557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b15b8a95-a49f-45c2-9884-c59ede6184ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:36.445134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 983/1955] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:36.455984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.457607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:36.495488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 973/1956] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:36.507356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484eadb-8a0f-43f3-b7b4-f5bd88c220a9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.510732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484eadb-8a0f-43f3-b7b4-f5bd88c220a9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.511037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484eadb-8a0f-43f3-b7b4-f5bd88c220a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.534766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8484eadb-8a0f-43f3-b7b4-f5bd88c220a9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:36.536172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8484eadb-8a0f-43f3-b7b4-f5bd88c220a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:36.538312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c4286-82c5-4f26-a1d2-f4865f572102 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.545151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 974/1957] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:36.545339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.546133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.546788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.547171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.549349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484eadb-8a0f-43f3-b7b4-f5bd88c220a9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.563559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484eadb-8a0f-43f3-b7b4-f5bd88c220a9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.570225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.572284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.573139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.573517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.574397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:36.574797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.576531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.579751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.581271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.590656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:36.600163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 975/1958] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:04:36.610727 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.611035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 984/1959] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:36.625064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be85c7-c74f-4692-bbcc-0017022b206e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.641720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.642414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.642705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.642988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.643736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.645749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.694884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 976/1960] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:36 2022] POST /identity/v3/projects => generated 366 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:36.697226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.709457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd69298-24fd-4c93-80a8-81c6d80bba6b service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.726301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:36.787200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.801660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.802997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.804624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.808109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.812088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.870213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 985/1961] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:36 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:36.875590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.894395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a457e-dd17-4d04-b13e-1fb84b3a0b05 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.902484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.903543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.904042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.904527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.905961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.908278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.926885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 977/1962] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:36 2022] GET /identity/v3/roles => generated 1427 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:36.927902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.944523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd0f8-d645-4bb6-8bba-d00848d30f6e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.950902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2400423-f34d-4d35-bbc4-5b52ed0bea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.951722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400423-f34d-4d35-bbc4-5b52ed0bea0b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.952225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400423-f34d-4d35-bbc4-5b52ed0bea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.952527 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400423-f34d-4d35-bbc4-5b52ed0bea0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:36.953230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2400423-f34d-4d35-bbc4-5b52ed0bea0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:36.954884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2400423-f34d-4d35-bbc4-5b52ed0bea0b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:36.973131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 986/1963] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:36 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:04:36.977005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:36.990671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b99f54-30b9-4777-bee9-2e8ad8a66122 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:36.997652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:36.998567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:36.998860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:36.999676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] PATH_INFO: `/v3/projects/56f68e8ca63c436aa2629b6090361b6a/users/52252a20acb342919c5b2cc3b3f83881/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.020906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f68e8ca63c436aa2629b6090361b6a, user_id=52252a20acb342919c5b2cc3b3f83881, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.022434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.044418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 978/1964] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:36 2022] PUT /identity/v3/projects/56f68e8ca63c436aa2629b6090361b6a/users/52252a20acb342919c5b2cc3b3f83881/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:37.055326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d797831-0c7c-4e7f-b62e-407c843ca377 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.055623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d797831-0c7c-4e7f-b62e-407c843ca377 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.055909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d797831-0c7c-4e7f-b62e-407c843ca377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.087577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9d797831-0c7c-4e7f-b62e-407c843ca377 None None] MFA Rules not processed for user `52252a20acb342919c5b2cc3b3f83881`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:37.089262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d797831-0c7c-4e7f-b62e-407c843ca377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:37.175690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 987/1965] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:37.181160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.293027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619cb23-dd23-4a55-996d-2cf3b8a09f55 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.301605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:37.302466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.302997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.304062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.304826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.307228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.350301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 979/1966] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:37 2022] POST /identity/v3/projects => generated 368 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:37.354480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d797831-0c7c-4e7f-b62e-407c843ca377 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.368035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d797831-0c7c-4e7f-b62e-407c843ca377 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.438360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:37.439146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.439570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.439980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.440772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.443247 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.482826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 988/1967] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:37 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:37.484342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.496828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9092868-0e87-46b8-a008-6e0c27a8da7d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.504173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:37.505593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.506039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.506366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.507086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.509980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.533920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 980/1968] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:37 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:37.538129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.549799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1920b-b4b3-43bb-886e-72ce7ac9b6de admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.556612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bafe8-df4e-4812-b162-96ab09af0ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:37.558158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bafe8-df4e-4812-b162-96ab09af0ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.558794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bafe8-df4e-4812-b162-96ab09af0ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.559297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bafe8-df4e-4812-b162-96ab09af0ae5 admin admin] PATH_INFO: `/v3/projects/d3b9448ff5074412a3c78f98eb34981d/users/3a388c765b924630bf06296b725e9c95/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.610044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:37.615726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bafe8-df4e-4812-b162-96ab09af0ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b9448ff5074412a3c78f98eb34981d, user_id=3a388c765b924630bf06296b725e9c95, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.620306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bafe8-df4e-4812-b162-96ab09af0ae5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.639933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 989/1969] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:37 2022] PUT /identity/v3/projects/d3b9448ff5074412a3c78f98eb34981d/users/3a388c765b924630bf06296b725e9c95/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:37.647575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.661069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d39ca-f326-4fb9-ad9f-10afe9c1b965 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.772479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.772768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.773048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.775147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:37.776223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.776223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.776683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.777508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.779966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.796829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 981/1970] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:37 2022] GET /identity/v3/roles => generated 1427 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:37.797886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.812420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] MFA Rules not processed for user `7ee529bb6399487eba7c2d339584268f`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:37.812980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a8dd-0dee-4821-b73d-7d6002772329 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.813634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:37.824435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa372661-9d50-4a04-aa7b-2b0418b94e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:37.825342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372661-9d50-4a04-aa7b-2b0418b94e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.825885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372661-9d50-4a04-aa7b-2b0418b94e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.826210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa372661-9d50-4a04-aa7b-2b0418b94e3b admin admin] PATH_INFO: `/v3/projects/d3b9448ff5074412a3c78f98eb34981d/users/3a388c765b924630bf06296b725e9c95/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.835770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372661-9d50-4a04-aa7b-2b0418b94e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b9448ff5074412a3c78f98eb34981d, user_id=3a388c765b924630bf06296b725e9c95, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:37.839418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa372661-9d50-4a04-aa7b-2b0418b94e3b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:37.877018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:37.889563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 982/1971] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:37 2022] PUT /identity/v3/projects/d3b9448ff5074412a3c78f98eb34981d/users/3a388c765b924630bf06296b725e9c95/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:37.903978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af799-9223-46ab-bb63-22b09db956cb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:37.904301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af799-9223-46ab-bb63-22b09db956cb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:37.904602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af799-9223-46ab-bb63-22b09db956cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:37.925036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 990/1972] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:37.932022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:37.936070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:37.957715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6183e2-71df-4da1-a1ee-f5e09e370264 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:37.961055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-903af799-9223-46ab-bb63-22b09db956cb None None] MFA Rules not processed for user `3a388c765b924630bf06296b725e9c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:37.964862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-903af799-9223-46ab-bb63-22b09db956cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:38.035593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.036246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.036544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.036818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.037507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.039561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.052172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 983/1973] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:38.064687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af799-9223-46ab-bb63-22b09db956cb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:38.067024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-903af799-9223-46ab-bb63-22b09db956cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:38.077934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 991/1974] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:37 2022] POST /identity/v3/projects => generated 372 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:38.082715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:38.163042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af799-9223-46ab-bb63-22b09db956cb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:38.191605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad2bce-a644-47c4-8a5c-3d570b40e022 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:38.197411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.198478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.198697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.199046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.199870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.202056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.215358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:38.230608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 992/1975] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:38 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:38.242199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:38.280048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0729f-e845-4452-a7f5-d966905ca89a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:38.287088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.288096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.288590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.289070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.293423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.295187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.295847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.296175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.297454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.300475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.328608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 993/1976] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:38 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:38.332697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:38.344746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ece507-cba4-4c14-b36d-0c45f883576f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:38.351684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.352669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.352669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.352945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] PATH_INFO: `/v3/projects/ce4db73c71004754865aa0aec45618d8/users/6b7c7caa7fd1480796c3de9d20c860e4/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.372027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:38.375712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4db73c71004754865aa0aec45618d8, user_id=6b7c7caa7fd1480796c3de9d20c860e4, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.379052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.386666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.388669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.405184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 984/1978] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:38.406678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:38.419147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 994/1978] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:38 2022] PUT /identity/v3/projects/ce4db73c71004754865aa0aec45618d8/users/6b7c7caa7fd1480796c3de9d20c860e4/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:38.420237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d20d2-3607-4049-bf7e-04b21aa9165e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:38.548449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.549515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.549775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.550173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.551019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.552039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:38.552633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.569926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 985/1979] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:38 2022] GET /identity/v3/roles => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:04:38.574900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:38.593096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd1fdf-5f12-4a26-88ec-914fdf53c576 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:38.602844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80ed8e-36ef-4ad7-ae95-f2e47a6fa382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.604674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ed8e-36ef-4ad7-ae95-f2e47a6fa382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.604674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ed8e-36ef-4ad7-ae95-f2e47a6fa382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.604674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ed8e-36ef-4ad7-ae95-f2e47a6fa382 admin admin] PATH_INFO: `/v3/projects/ce4db73c71004754865aa0aec45618d8/users/6b7c7caa7fd1480796c3de9d20c860e4/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.606902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80ed8e-36ef-4ad7-ae95-f2e47a6fa382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4db73c71004754865aa0aec45618d8, user_id=6b7c7caa7fd1480796c3de9d20c860e4, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.610004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80ed8e-36ef-4ad7-ae95-f2e47a6fa382 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.623899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 986/1980] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:38 2022] PUT /identity/v3/projects/ce4db73c71004754865aa0aec45618d8/users/6b7c7caa7fd1480796c3de9d20c860e4/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:38.644102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23e5a-0019-4b9b-b5e9-f39bf5252e01 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:38.721267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527f273-6349-474b-a36f-e41f9c7daad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:38.722019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f273-6349-474b-a36f-e41f9c7daad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:38.723264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f273-6349-474b-a36f-e41f9c7daad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:38.723633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f273-6349-474b-a36f-e41f9c7daad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:38.832161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527f273-6349-474b-a36f-e41f9c7daad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:38.833492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527f273-6349-474b-a36f-e41f9c7daad6 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:38.886414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 995/1981] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:40.551655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:40.552265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:40.552265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:40.614490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] MFA Rules not processed for user `6b7c7caa7fd1480796c3de9d20c860e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:40.617409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:40.764372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 987/1982] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:40.778129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4b82-1867-476b-8d3f-32d13b9a1dcf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:40.778129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4b82-1867-476b-8d3f-32d13b9a1dcf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:40.783075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4b82-1867-476b-8d3f-32d13b9a1dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:40.837550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7f5f4b82-1867-476b-8d3f-32d13b9a1dcf None None] MFA Rules not processed for user `7ee529bb6399487eba7c2d339584268f`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:40.840686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7f5f4b82-1867-476b-8d3f-32d13b9a1dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:40.881613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:40.950322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 996/1983] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:40.960801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:40.962519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:41.068506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:41.090066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae175-2ad7-41c3-8a1a-bba8f5b1d0ad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:41.096888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f47d1-b25e-4c06-a912-b4830c594f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:41.097545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f47d1-b25e-4c06-a912-b4830c594f9f service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:41.097904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f47d1-b25e-4c06-a912-b4830c594f9f service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:41.098100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f47d1-b25e-4c06-a912-b4830c594f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:41.108548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f47d1-b25e-4c06-a912-b4830c594f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:41.110460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f47d1-b25e-4c06-a912-b4830c594f9f service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:41.121664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 988/1984] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:44.724195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f4b82-1867-476b-8d3f-32d13b9a1dcf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:44.826972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f4b82-1867-476b-8d3f-32d13b9a1dcf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:44.842703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:44.843381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:44.843643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:44.843924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] PATH_INFO: `/v3/users/52252a20acb342919c5b2cc3b3f83881` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:44.845207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=52252a20acb342919c5b2cc3b3f83881)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:44.848315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:44.929882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52252a20acb342919c5b2cc3b3f83881'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:44.939249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52252a20acb342919c5b2cc3b3f83881'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:44.961086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52252a20acb342919c5b2cc3b3f83881'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:44.961886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52252a20acb342919c5b2cc3b3f83881'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:44.962965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52252a20acb342919c5b2cc3b3f83881'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:44.998691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 997/1985] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:44 2022] DELETE /identity/v3/users/52252a20acb342919c5b2cc3b3f83881 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:44.999494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:44.999958 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:45.000043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:45.023324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:45.025061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:45.127373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 989/1986] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:45.139307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:45.141155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:45.287640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a337c-761d-4e6d-a744-c8b927a3eccd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:45.296444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:45.296878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:45.297168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:45.297964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:45.319792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:45.322788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:45.328133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:45.339461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 998/1987] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:45.837954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:45.840247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:45.859675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb928ee-db01-4f94-87a3-2075baf03351 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:45.867164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:45.868317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:45.868594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:45.868871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] PATH_INFO: `/v3/projects/56f68e8ca63c436aa2629b6090361b6a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:45.870192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f68e8ca63c436aa2629b6090361b6a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:45.873545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:45.950218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f68e8ca63c436aa2629b6090361b6a', 'request_id': 'req-bf58e470-4557-447d-b425-bb558d93673c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:45.957370 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f68e8ca63c436aa2629b6090361b6a', 'request_id': 'req-bf58e470-4557-447d-b425-bb558d93673c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:45.967250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f68e8ca63c436aa2629b6090361b6a', 'request_id': 'req-bf58e470-4557-447d-b425-bb558d93673c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:45.982219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] The token cache is being invalidate because project 56f68e8ca63c436aa2629b6090361b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:45.982766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:45.983462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:45.985077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 990/1988] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:45 2022] DELETE /identity/v3/projects/56f68e8ca63c436aa2629b6090361b6a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:45.989336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:46.001019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da947e-4312-4920-b27f-2b8c5fe50a15 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:46.066645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:46.067314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:46.067599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:46.067877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] PATH_INFO: `/v3/users/3a388c765b924630bf06296b725e9c95` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:46.069094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a388c765b924630bf06296b725e9c95)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:46.071114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:46.126533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a388c765b924630bf06296b725e9c95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.135938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a388c765b924630bf06296b725e9c95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.151635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a388c765b924630bf06296b725e9c95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.152487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a388c765b924630bf06296b725e9c95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.153245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-615a26ae-7e24-4093-af1b-6dcab1156ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a388c765b924630bf06296b725e9c95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.170941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 999/1989] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:45 2022] DELETE /identity/v3/users/3a388c765b924630bf06296b725e9c95 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:46.493513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:46.497438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:46.529471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58e470-4557-447d-b425-bb558d93673c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:46.716470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:46.717505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:46.717987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:46.718489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] PATH_INFO: `/v3/projects/d3b9448ff5074412a3c78f98eb34981d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:46.720587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b9448ff5074412a3c78f98eb34981d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:46.725285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:46.757690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:46.813017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b9448ff5074412a3c78f98eb34981d', 'request_id': 'req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.822209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b9448ff5074412a3c78f98eb34981d', 'request_id': 'req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.839979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b9448ff5074412a3c78f98eb34981d', 'request_id': 'req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.855196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] The token cache is being invalidate because project d3b9448ff5074412a3c78f98eb34981d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:46.855493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.856180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e2a9230-3c03-4502-84a6-fcf6e8fc2599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:46.857847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 991/1990] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:46 2022] DELETE /identity/v3/projects/d3b9448ff5074412a3c78f98eb34981d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:46.863016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f890bb-dd71-4a50-9388-c98fd8bf906c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:46.863308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f890bb-dd71-4a50-9388-c98fd8bf906c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:46.863592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f890bb-dd71-4a50-9388-c98fd8bf906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:46.899699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f6f890bb-dd71-4a50-9388-c98fd8bf906c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:46.901044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f6f890bb-dd71-4a50-9388-c98fd8bf906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:46.971019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1000/1991] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:46.978971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ce5c-29a6-436e-bd1a-6e997504a3ec None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:46.979263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ce5c-29a6-436e-bd1a-6e997504a3ec None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:46.979544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174ce5c-29a6-436e-bd1a-6e997504a3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.004548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8174ce5c-29a6-436e-bd1a-6e997504a3ec None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:47.005791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8174ce5c-29a6-436e-bd1a-6e997504a3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:47.014951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 992/1992] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:47.019398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f890bb-dd71-4a50-9388-c98fd8bf906c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.031176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f890bb-dd71-4a50-9388-c98fd8bf906c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.036242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.036880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.037168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.037439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.038845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:47.039155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.040758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.055979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1001/1993] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:04:47.071134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ce5c-29a6-436e-bd1a-6e997504a3ec None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.083606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174ce5c-29a6-436e-bd1a-6e997504a3ec None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.088848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.089495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.089792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.090074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.090767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.092696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.140192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 993/1994] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:47 2022] POST /identity/v3/projects => generated 380 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:47.144485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.151415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:47.168216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294ae3c-579e-4039-911d-e01f1e601f12 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.255834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.256365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.256652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.256930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.257631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.260138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.284333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1002/1995] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:47 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:47.290899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.302772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011ad43-8545-4fe0-9664-999a1e81e59f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.308073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.308806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.309103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.309411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.310081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.311807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.331771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 994/1996] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:47 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:47.333358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.345703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a4d61-29f8-4c66-9d32-69f7a6b07d00 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.352038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d5370-4907-4064-b544-d9ee8f4bd956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.352757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5370-4907-4064-b544-d9ee8f4bd956 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.353109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5370-4907-4064-b544-d9ee8f4bd956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.353463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5370-4907-4064-b544-d9ee8f4bd956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.354283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d5370-4907-4064-b544-d9ee8f4bd956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.356046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d5370-4907-4064-b544-d9ee8f4bd956 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.372786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1003/1997] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:47 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:47.374300 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.390242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c550a9-2db8-4b86-8942-91e84dd55277 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.398185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.400246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.401461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.401461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] PATH_INFO: `/v3/projects/255d37c4a8df4c90a9a6057918578bcd/users/6ec3e3d9a6ce445984c60209164dd7b2/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.423821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=255d37c4a8df4c90a9a6057918578bcd, user_id=6ec3e3d9a6ce445984c60209164dd7b2, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.427428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.451844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 995/1998] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:47 2022] PUT /identity/v3/projects/255d37c4a8df4c90a9a6057918578bcd/users/6ec3e3d9a6ce445984c60209164dd7b2/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:47.464010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90eb2-f25f-4082-8041-5105b22745ae None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.464301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90eb2-f25f-4082-8041-5105b22745ae None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.464588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90eb2-f25f-4082-8041-5105b22745ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.496384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7af90eb2-f25f-4082-8041-5105b22745ae None None] MFA Rules not processed for user `6ec3e3d9a6ce445984c60209164dd7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:47.497647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7af90eb2-f25f-4082-8041-5105b22745ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:47.621290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1004/1999] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:47.629695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.761144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52604f-1fcf-4ea2-bca3-edd48d7f56ee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.771905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.773293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.773293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.773775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.775073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.778335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.825671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 996/2000] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:47 2022] POST /identity/v3/projects => generated 384 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:47.830093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90eb2-f25f-4082-8041-5105b22745ae None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.844339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90eb2-f25f-4082-8041-5105b22745ae None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.939276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.940102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.940731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.940731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.941538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:47.943572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:47.968185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1005/2001] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:47 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:47.973225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:47.990228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a103bf-f66b-4b2d-9592-485fd62eb515 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:47.996184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:47.996941 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:47.997290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:47.997630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:47.998383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:48.000037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:48.012628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 997/2002] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:47 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:48.017253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:48.027187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:48.053323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c149ab-9800-4cbf-9a2e-895018fca11d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:48.061294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:48.062025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:48.062418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:48.062763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] PATH_INFO: `/v3/projects/dd4e4de1fc114aa8bb3f9e2230fdcdf2/users/98ad276719b44558b5f25324dc2ee673/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:48.086780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4e4de1fc114aa8bb3f9e2230fdcdf2, user_id=98ad276719b44558b5f25324dc2ee673, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:48.091886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:48.119819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:48.126376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1006/2003] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:48 2022] PUT /identity/v3/projects/dd4e4de1fc114aa8bb3f9e2230fdcdf2/users/98ad276719b44558b5f25324dc2ee673/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:48.135746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f83adc-94ac-4d75-a10c-b4d8f167b88e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:48.142177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:48.255942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ceb119-bc60-471e-b067-34d959899b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:48.256991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb119-bc60-471e-b067-34d959899b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:48.257465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb119-bc60-471e-b067-34d959899b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:48.259470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb119-bc60-471e-b067-34d959899b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:48.260629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ceb119-bc60-471e-b067-34d959899b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:48.263678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ceb119-bc60-471e-b067-34d959899b88 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:48.281406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 998/2004] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:48 2022] GET /identity/v3/roles => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:48.285435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:48.303379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df7b57-06b3-41a8-9a99-ac55aed3f841 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:48.311969 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:48.312687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:48.312982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:48.313321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] PATH_INFO: `/v3/projects/dd4e4de1fc114aa8bb3f9e2230fdcdf2/users/98ad276719b44558b5f25324dc2ee673/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:48.315603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4e4de1fc114aa8bb3f9e2230fdcdf2, user_id=98ad276719b44558b5f25324dc2ee673, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:48.318533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:48.330512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1007/2005] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:48 2022] PUT /identity/v3/projects/dd4e4de1fc114aa8bb3f9e2230fdcdf2/users/98ad276719b44558b5f25324dc2ee673/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:48.340747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858fc95-868b-487c-9b56-963dfc2ff04f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:48.341042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858fc95-868b-487c-9b56-963dfc2ff04f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:48.341332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858fc95-868b-487c-9b56-963dfc2ff04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:48.370164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1858fc95-868b-487c-9b56-963dfc2ff04f None None] MFA Rules not processed for user `98ad276719b44558b5f25324dc2ee673`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:48.371454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1858fc95-868b-487c-9b56-963dfc2ff04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:48.457752 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 999/2006] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:48.469404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:48.471138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:48.558496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d589aa9-5145-45ee-9b74-a5993e5b4cfd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:48.562377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:48.563019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:48.563307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:48.563583 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:48.574073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:48.575841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:48.589547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1008/2007] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:48.675913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858fc95-868b-487c-9b56-963dfc2ff04f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:48.688192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858fc95-868b-487c-9b56-963dfc2ff04f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:48.692644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a203c6-2892-4187-a93b-95085e711e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:48.693493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a203c6-2892-4187-a93b-95085e711e61 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:48.693874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a203c6-2892-4187-a93b-95085e711e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:48.694242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a203c6-2892-4187-a93b-95085e711e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:48.758094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a203c6-2892-4187-a93b-95085e711e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:48.759611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a203c6-2892-4187-a93b-95085e711e61 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:48.768976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1000/2008] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:49.169276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:49.275612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7153af2-489c-4ea3-adce-0224579dc46f service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:49.283389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:49.284525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:49.285058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:49.285559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] PATH_INFO: `/v3/users/6ec3e3d9a6ce445984c60209164dd7b2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:49.287301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec3e3d9a6ce445984c60209164dd7b2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:49.289354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:49.366616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec3e3d9a6ce445984c60209164dd7b2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:49.376107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec3e3d9a6ce445984c60209164dd7b2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:49.391373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:49.405071 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec3e3d9a6ce445984c60209164dd7b2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:49.406712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec3e3d9a6ce445984c60209164dd7b2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:49.407334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec3e3d9a6ce445984c60209164dd7b2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:49.432177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1009/2009] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:49 2022] DELETE /identity/v3/users/6ec3e3d9a6ce445984c60209164dd7b2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:49.437847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:49.439129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:49.439129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:49.466127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:49.467569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:49.500128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:49.558243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1001/2010] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:49.568147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:49.569923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:49.694664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb331-3ced-4d35-9463-1df09730ac1c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:49.702806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:49.703720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:49.704077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:49.704752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:49.718553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:49.720347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:49.734743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1010/2011] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:50.048707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:50.050318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:50.089069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d317c0-f7b2-4daf-b170-ad6e0fef2ea8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:50.111066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:50.111887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:50.112315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:50.112659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] PATH_INFO: `/v3/projects/255d37c4a8df4c90a9a6057918578bcd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:50.114453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=255d37c4a8df4c90a9a6057918578bcd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:50.116670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:50.191731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255d37c4a8df4c90a9a6057918578bcd', 'request_id': 'req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.200897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255d37c4a8df4c90a9a6057918578bcd', 'request_id': 'req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.210829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255d37c4a8df4c90a9a6057918578bcd', 'request_id': 'req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.224709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] The token cache is being invalidate because project 255d37c4a8df4c90a9a6057918578bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:50.224709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.225575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.230582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1002/2012] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:50 2022] DELETE /identity/v3/projects/255d37c4a8df4c90a9a6057918578bcd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:50.231903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:50.242837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595f1f-0f64-48e2-ad35-fb9f5535279e service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:50.338693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:50.339469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:50.339903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:50.340192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] PATH_INFO: `/v3/users/98ad276719b44558b5f25324dc2ee673` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:50.341423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ad276719b44558b5f25324dc2ee673)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:50.343432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:50.417201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ad276719b44558b5f25324dc2ee673'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.427273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ad276719b44558b5f25324dc2ee673'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.456362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ad276719b44558b5f25324dc2ee673'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.457378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ad276719b44558b5f25324dc2ee673'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.458013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fb5a3ee1-df2c-40de-ab1a-d675e7a19141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ad276719b44558b5f25324dc2ee673'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:50.481627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1011/2013] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:50 2022] DELETE /identity/v3/users/98ad276719b44558b5f25324dc2ee673 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:50.934735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:50.936348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:50.950767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d25cc-d134-458e-8ba7-0b6a5a25b8c8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:51.090431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:51.092291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.092796 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.093413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] PATH_INFO: `/v3/projects/dd4e4de1fc114aa8bb3f9e2230fdcdf2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.106124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4e4de1fc114aa8bb3f9e2230fdcdf2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:51.109076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:51.202957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4e4de1fc114aa8bb3f9e2230fdcdf2', 'request_id': 'req-35e4728e-d6ae-4268-9e09-2737ba158fc4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:51.237116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4e4de1fc114aa8bb3f9e2230fdcdf2', 'request_id': 'req-35e4728e-d6ae-4268-9e09-2737ba158fc4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:51.242945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:51.260213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4e4de1fc114aa8bb3f9e2230fdcdf2', 'request_id': 'req-35e4728e-d6ae-4268-9e09-2737ba158fc4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:51.286765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] The token cache is being invalidate because project dd4e4de1fc114aa8bb3f9e2230fdcdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:51.287230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:51.288536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-35e4728e-d6ae-4268-9e09-2737ba158fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:51.294307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1003/2014] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:50 2022] DELETE /identity/v3/projects/dd4e4de1fc114aa8bb3f9e2230fdcdf2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:51.296783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824246c5-4969-4186-8eba-c1dd33b2dd89 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.297784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824246c5-4969-4186-8eba-c1dd33b2dd89 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.298156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824246c5-4969-4186-8eba-c1dd33b2dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.332874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-824246c5-4969-4186-8eba-c1dd33b2dd89 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:51.334586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-824246c5-4969-4186-8eba-c1dd33b2dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:51.340515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:51.421459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1012/2015] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:51.424340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6c70-e69a-42d2-8acc-fa1400f26a97 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.425132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6c70-e69a-42d2-8acc-fa1400f26a97 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.425470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d6c70-e69a-42d2-8acc-fa1400f26a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.464812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-599d6c70-e69a-42d2-8acc-fa1400f26a97 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:51.466078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-599d6c70-e69a-42d2-8acc-fa1400f26a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:51.476719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1004/2016] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:51.484871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824246c5-4969-4186-8eba-c1dd33b2dd89 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:51.501752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824246c5-4969-4186-8eba-c1dd33b2dd89 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:51.519681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:51.520414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.520701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.521092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.521980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:51.522890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:51.524974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:51.541851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1013/2017] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:51.545901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6c70-e69a-42d2-8acc-fa1400f26a97 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:51.562080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d6c70-e69a-42d2-8acc-fa1400f26a97 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:51.569129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:51.570297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.570297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.571282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.572741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:51.575334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:51.625711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1005/2018] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:51 2022] POST /identity/v3/projects => generated 382 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:51.630870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:51.644245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6706cf-3336-407f-b023-435f1ab5d98c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:51.735525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:51.736181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.737073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.737373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.738638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:51.743374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:51.776167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1014/2019] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:51 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:51.779926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:51.797103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34151cd-426a-4af3-b7eb-dd9fede572b8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:51.802545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:51.803311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.804236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.804236 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.805529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:51.807431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:51.842049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1006/2020] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:51 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:51.846384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:51.859366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1105f29-eb3b-4b21-b38f-76aac7863ee1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:51.864894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6aee5-ec26-48a6-adb0-380fddcca76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:51.865610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6aee5-ec26-48a6-adb0-380fddcca76b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.865981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6aee5-ec26-48a6-adb0-380fddcca76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.866567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6aee5-ec26-48a6-adb0-380fddcca76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.867977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6aee5-ec26-48a6-adb0-380fddcca76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:51.869875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6aee5-ec26-48a6-adb0-380fddcca76b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:51.886063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1015/2021] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:51 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:51.889991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:51.905701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2c0a9-e351-40c0-8f51-28cea4ef9912 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:51.919644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:51.920356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:51.920647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:51.920932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] PATH_INFO: `/v3/projects/e947fa68bf6d41a49ff62ac1745e2db8/users/29a7aed83b0d456da3709086f18418ba/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:51.959545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e947fa68bf6d41a49ff62ac1745e2db8, user_id=29a7aed83b0d456da3709086f18418ba, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:51.962497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:52.005246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1007/2022] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:51 2022] PUT /identity/v3/projects/e947fa68bf6d41a49ff62ac1745e2db8/users/29a7aed83b0d456da3709086f18418ba/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:52.094719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9b95-a0f2-4816-8d03-1b837ce39ee8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.094719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9b95-a0f2-4816-8d03-1b837ce39ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.094719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d9b95-a0f2-4816-8d03-1b837ce39ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.148089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e46d9b95-a0f2-4816-8d03-1b837ce39ee8 None None] MFA Rules not processed for user `29a7aed83b0d456da3709086f18418ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:52.150124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e46d9b95-a0f2-4816-8d03-1b837ce39ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:52.244030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1016/2023] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:52.249306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:52.373846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af62c2d-92ee-4447-b2e3-8b8317812fe5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:52.379771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:52.380871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.381309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.381902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.383126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:52.386666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:52.429212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1008/2024] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:52 2022] POST /identity/v3/projects => generated 384 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:52.434883 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9b95-a0f2-4816-8d03-1b837ce39ee8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:52.443481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:52.463576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d9b95-a0f2-4816-8d03-1b837ce39ee8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:52.553003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:52.553654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.554056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.554544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.555652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:52.557673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:52.585563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1017/2025] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:52 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:52.586972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:52.598818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb3a11-ee78-4b0d-9859-f27b226faa03 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:52.604690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:52.605328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.605616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.605894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.606633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:52.608267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:52.622031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1009/2026] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:52 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:52.631536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:52.643882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7bd8e-57ef-4af2-9488-d296f17a2514 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:52.649857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebf3e4-b73a-4a6a-a09c-fd6f428cff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:52.651435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf3e4-b73a-4a6a-a09c-fd6f428cff57 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.651775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf3e4-b73a-4a6a-a09c-fd6f428cff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.652157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebf3e4-b73a-4a6a-a09c-fd6f428cff57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.653167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebf3e4-b73a-4a6a-a09c-fd6f428cff57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:52.654833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebf3e4-b73a-4a6a-a09c-fd6f428cff57 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:52.666597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1018/2027] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:52 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:52.671610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:52.683167 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bace0-06d4-4966-8cf2-f7d5edf10eac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:52.687798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:52.688422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.688700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.689117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] PATH_INFO: `/v3/projects/8be9c0f3dbbb43bbb24d3a6cdf70ee82/users/9a440b8f0f7f4aaaa04b83a826bde193/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.709708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be9c0f3dbbb43bbb24d3a6cdf70ee82, user_id=9a440b8f0f7f4aaaa04b83a826bde193, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:52.712561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:52.736151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1010/2028] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:52 2022] PUT /identity/v3/projects/8be9c0f3dbbb43bbb24d3a6cdf70ee82/users/9a440b8f0f7f4aaaa04b83a826bde193/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:52.747165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c04cc-b231-4f52-ae7b-5514a79d6a2b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.747459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c04cc-b231-4f52-ae7b-5514a79d6a2b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.747745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c04cc-b231-4f52-ae7b-5514a79d6a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.778000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b68c04cc-b231-4f52-ae7b-5514a79d6a2b None None] MFA Rules not processed for user `9a440b8f0f7f4aaaa04b83a826bde193`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:52.779161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b68c04cc-b231-4f52-ae7b-5514a79d6a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:52.850028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1019/2029] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:52.856455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:52.899283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:52.924117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3fd7a-f794-46bc-9252-9ff003a6d385 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.924636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3fd7a-f794-46bc-9252-9ff003a6d385 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.925277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3fd7a-f794-46bc-9252-9ff003a6d385 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.928102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1020/2030] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:04:52 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:04:52.945076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea96a4-648a-4fac-840c-ebbc1ef71046 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:52.951162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:52.952181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.953228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.953404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047e72-baa4-45ef-89a4-28823eae29e5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:52.953404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047e72-baa4-45ef-89a4-28823eae29e5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:52.953701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.954915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:52.955053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62047e72-baa4-45ef-89a4-28823eae29e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:52.956705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:52.993632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-62047e72-baa4-45ef-89a4-28823eae29e5 None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:52.996952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-62047e72-baa4-45ef-89a4-28823eae29e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.026929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1011/2031] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:52 2022] POST /identity/v3/projects => generated 384 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:53.028631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.036473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.118460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1021/2032] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:53.119760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62047e72-baa4-45ef-89a4-28823eae29e5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.141705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62047e72-baa4-45ef-89a4-28823eae29e5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.154784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.156677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e81e-8bb1-406f-bdea-f587110b4535 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.157479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.157776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.158056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.158812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.163613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.165091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.165849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.166207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.166737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] PATH_INFO: `/v3/users/78c65d4466174c9bb8c931af6befd6c2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.168076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c65d4466174c9bb8c931af6befd6c2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.172716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.178136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:53.205526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1022/2033] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:53 2022] POST /identity/v3/users => generated 299 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:53.207523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.210700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.266469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c65d4466174c9bb8c931af6befd6c2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.276383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c65d4466174c9bb8c931af6befd6c2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.277801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c65d4466174c9bb8c931af6befd6c2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.278552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c65d4466174c9bb8c931af6befd6c2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.290627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c65d4466174c9bb8c931af6befd6c2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.317146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1012/2034] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:53 2022] DELETE /identity/v3/users/78c65d4466174c9bb8c931af6befd6c2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:53.318249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.319616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.373437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d7ff-0235-4afe-9b16-9425c1fdce48 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.410576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:53.500312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c6195-c4be-4d39-b52f-7e31fb59b54e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.516892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.521833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.524542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.525284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.527263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.533064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.560335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1013/2035] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:53 2022] GET /identity/v3/roles => generated 1427 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:53.566504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.573618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.574888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.575388 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.575991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.579442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.600180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea8f5-e7ee-450f-8408-02036c718b1f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.605701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.609068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.625067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.625817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.626109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.626411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] PATH_INFO: `/v3/projects/3540397fb89e4c08a573da5db448cb29/users/a19dbcc3de7a4e6aaebe38f278119d94/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.630690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1023/2036] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:53.685104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3540397fb89e4c08a573da5db448cb29, user_id=a19dbcc3de7a4e6aaebe38f278119d94, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.691361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.719628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1014/2037] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:53 2022] PUT /identity/v3/projects/3540397fb89e4c08a573da5db448cb29/users/a19dbcc3de7a4e6aaebe38f278119d94/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:53.723930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.744369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28dd16-0ef2-44f8-8e5b-edb513ee0ff2 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.827687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.830661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.842543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.843850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.844469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.845084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.847079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.855069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.867351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8f291-69b8-4baa-a39f-594e47946ac8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.876642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.878591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1024/2038] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:53 2022] GET /identity/v3/roles => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:53.882826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:53.882992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.883381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.883969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] PATH_INFO: `/v3/projects/ca3d02d4abc749858513bcb8a75ff3cd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.898758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3d02d4abc749858513bcb8a75ff3cd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.900713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.906734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0852e-4a25-4644-89ce-c80f60faba37 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:53.917682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582028b-706f-4f17-84dd-83bbe99c2dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:53.918407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582028b-706f-4f17-84dd-83bbe99c2dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.918690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582028b-706f-4f17-84dd-83bbe99c2dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.918960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582028b-706f-4f17-84dd-83bbe99c2dc3 admin admin] PATH_INFO: `/v3/projects/3540397fb89e4c08a573da5db448cb29/users/a19dbcc3de7a4e6aaebe38f278119d94/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.921091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582028b-706f-4f17-84dd-83bbe99c2dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3540397fb89e4c08a573da5db448cb29, user_id=a19dbcc3de7a4e6aaebe38f278119d94, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:53.923823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582028b-706f-4f17-84dd-83bbe99c2dc3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:53.937999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1025/2039] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:53 2022] PUT /identity/v3/projects/3540397fb89e4c08a573da5db448cb29/users/a19dbcc3de7a4e6aaebe38f278119d94/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:53.950058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:53.950606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:53.951098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:53.964241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3d02d4abc749858513bcb8a75ff3cd', 'request_id': 'req-7bfb11c5-eade-42ec-8654-7b49919ed6f1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.966779 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:53.970770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3d02d4abc749858513bcb8a75ff3cd', 'request_id': 'req-7bfb11c5-eade-42ec-8654-7b49919ed6f1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.981882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3d02d4abc749858513bcb8a75ff3cd', 'request_id': 'req-7bfb11c5-eade-42ec-8654-7b49919ed6f1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.989757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] MFA Rules not processed for user `a19dbcc3de7a4e6aaebe38f278119d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:53.991018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:53.995410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] The token cache is being invalidate because project ca3d02d4abc749858513bcb8a75ff3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:53.995706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.996417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bfb11c5-eade-42ec-8654-7b49919ed6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:53.998012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1015/2040] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:53 2022] DELETE /identity/v3/projects/ca3d02d4abc749858513bcb8a75ff3cd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:54.011409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4cc13-5195-48d4-a249-4d9eba73f456 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.011409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4cc13-5195-48d4-a249-4d9eba73f456 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.012738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4cc13-5195-48d4-a249-4d9eba73f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.035139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f5b4cc13-5195-48d4-a249-4d9eba73f456 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:54.036305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f5b4cc13-5195-48d4-a249-4d9eba73f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:54.095838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1026/2041] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:54.113891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:54.116212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:54.118342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1016/2042] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:54.126985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411c68-94b3-4626-98b6-bf77d8d79df1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.127279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411c68-94b3-4626-98b6-bf77d8d79df1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.127581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411c68-94b3-4626-98b6-bf77d8d79df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.149788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ae411c68-94b3-4626-98b6-bf77d8d79df1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:54.151160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae411c68-94b3-4626-98b6-bf77d8d79df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:54.165138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1017/2043] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:04:54.169485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411c68-94b3-4626-98b6-bf77d8d79df1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:54.186505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411c68-94b3-4626-98b6-bf77d8d79df1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:54.191942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:54.192589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.192881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.193162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.193916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:54.194232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:54.196227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:54.207015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d799cac-b587-4b28-9ecb-66f296d16bb0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:54.211001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:54.211722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.212134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.212426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.217310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:54.222058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1018/2044] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:04:54.227791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:54.252311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c94c4-484b-45d3-a3fd-a8931fb64647 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:54.271303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:54.274756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.275030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.275598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.276574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:54.279026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:54.289454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:54.359507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1019/2045] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:54 2022] POST /identity/v3/projects => generated 406 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:54.367965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:54.371804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:54.388733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:54.405939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1027/2046] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:54.533307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927a3a1-9a0d-4b96-a01f-626dc0329495 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:54.544200 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:54.546746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.546746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.546746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.547877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:54.552251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:54.595368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1020/2047] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:54 2022] POST /identity/v3/users => generated 304 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:54.613300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:54.634083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d6db7-18d9-4a39-beb3-5286159d606f service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:54.640490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:54.641257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.641595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.642025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.643549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:54.646790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:54.667470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1028/2048] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:54 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:54.672136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:54.687643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cb16a-fa40-4a09-b04c-65d3dac358d6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:54.702484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3a77b-e6e3-494a-9be1-b1cc2e4fbc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:54.704876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a77b-e6e3-494a-9be1-b1cc2e4fbc1f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.705979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a77b-e6e3-494a-9be1-b1cc2e4fbc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.706665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a77b-e6e3-494a-9be1-b1cc2e4fbc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.708888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3a77b-e6e3-494a-9be1-b1cc2e4fbc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:54.712638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3a77b-e6e3-494a-9be1-b1cc2e4fbc1f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:54.738246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1021/2049] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:54 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:04:54.742518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:54.759022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10764777-5328-4ac7-899b-37ffd277b26e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:54.780977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:54.781865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.782481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.784213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] PATH_INFO: `/v3/projects/37e76bd889d4401288ee56ec7f48bb3f/users/7880e2b18b64463681f81416fb56f818/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.806021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e76bd889d4401288ee56ec7f48bb3f, user_id=7880e2b18b64463681f81416fb56f818, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:54.809604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:54.837550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1029/2050] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:54 2022] PUT /identity/v3/projects/37e76bd889d4401288ee56ec7f48bb3f/users/7880e2b18b64463681f81416fb56f818/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:54.846756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c332-1092-4169-8401-44f60c719691 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:54.847306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c332-1092-4169-8401-44f60c719691 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:54.847607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849c332-1092-4169-8401-44f60c719691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:54.916007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c849c332-1092-4169-8401-44f60c719691 None None] MFA Rules not processed for user `7880e2b18b64463681f81416fb56f818`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:54.932000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c849c332-1092-4169-8401-44f60c719691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:55.080681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1022/2051] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:55.097966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:55.120973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:55.186510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be356d1-1bf5-4c44-b283-5666790fc94e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:55.192062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:55.192799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.193085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.193524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.194398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:55.196655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:55.237250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1030/2052] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:55 2022] POST /identity/v3/projects => generated 404 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:55.241755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849c332-1092-4169-8401-44f60c719691 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:55.254189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849c332-1092-4169-8401-44f60c719691 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:55.315199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:55.324368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:55.325010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.325296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.325576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.326303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:55.328431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:55.353493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1023/2053] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:55 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:55.357838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:55.369852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437216fd-e6d2-4bd3-962a-08bb77ac2eac admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:55.374914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:55.375554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.375842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.376123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.376957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:55.378623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:55.392755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1031/2054] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:55 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:04:55.397785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:55.409140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63321c3a-16b1-42d1-a391-eba90d4641eb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:55.414370 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:55.415083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.415400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.415685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] PATH_INFO: `/v3/projects/719ee08cba194f35a2c5d962cf1b18a8/users/8a83ad2b77cf40d09daa06db1147abba/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.434018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719ee08cba194f35a2c5d962cf1b18a8, user_id=8a83ad2b77cf40d09daa06db1147abba, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:55.436987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:55.455674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1024/2055] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:55 2022] PUT /identity/v3/projects/719ee08cba194f35a2c5d962cf1b18a8/users/8a83ad2b77cf40d09daa06db1147abba/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:55.461533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:55.474185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388572-6f1f-4cde-b95a-b6475bd8165b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:55.542170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028d71-fd39-414b-84ff-738182aacbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:55.542750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028d71-fd39-414b-84ff-738182aacbdd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.543027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028d71-fd39-414b-84ff-738182aacbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.543298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028d71-fd39-414b-84ff-738182aacbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.544002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc028d71-fd39-414b-84ff-738182aacbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:55.545627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc028d71-fd39-414b-84ff-738182aacbdd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:55.556591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1032/2056] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:55 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:55.561127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:55.572336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656e77-3f63-4492-9617-3bc58e99e922 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:55.577202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:55.577888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.578173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.578600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] PATH_INFO: `/v3/projects/719ee08cba194f35a2c5d962cf1b18a8/users/8a83ad2b77cf40d09daa06db1147abba/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.580558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] RBAC: Authorizing `identity:create_grant(project_id=719ee08cba194f35a2c5d962cf1b18a8, user_id=8a83ad2b77cf40d09daa06db1147abba, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:55.583626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:55.600334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1025/2057] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:55 2022] PUT /identity/v3/projects/719ee08cba194f35a2c5d962cf1b18a8/users/8a83ad2b77cf40d09daa06db1147abba/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:55.612044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fc32-c19c-436c-ac33-f3400f17b056 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.612398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fc32-c19c-436c-ac33-f3400f17b056 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.612684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90fc32-c19c-436c-ac33-f3400f17b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.645157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4e90fc32-c19c-436c-ac33-f3400f17b056 None None] MFA Rules not processed for user `8a83ad2b77cf40d09daa06db1147abba`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:55.646457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4e90fc32-c19c-436c-ac33-f3400f17b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:55.742656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1033/2058] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:55.754886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:55.756368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:55.852790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58023e-d243-48f1-a0cc-0853abb6299d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:55.852790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963d66b-6179-407e-95f1-e5c6a496fbe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:55.852790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963d66b-6179-407e-95f1-e5c6a496fbe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:55.852790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963d66b-6179-407e-95f1-e5c6a496fbe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:55.853281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963d66b-6179-407e-95f1-e5c6a496fbe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:55.864129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963d66b-6179-407e-95f1-e5c6a496fbe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:55.865620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963d66b-6179-407e-95f1-e5c6a496fbe0 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:55.877847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1026/2059] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:55 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:56.080375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90fc32-c19c-436c-ac33-f3400f17b056 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:56.103777 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:56.218746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90fc32-c19c-436c-ac33-f3400f17b056 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:56.225800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:56.234506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:56.234506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:56.234506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] PATH_INFO: `/v3/users/7880e2b18b64463681f81416fb56f818` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:56.234506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7880e2b18b64463681f81416fb56f818)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:56.234506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:56.328714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7880e2b18b64463681f81416fb56f818'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:56.339878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7880e2b18b64463681f81416fb56f818'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:56.358854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7880e2b18b64463681f81416fb56f818'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:56.359641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7880e2b18b64463681f81416fb56f818'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:56.360402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7880e2b18b64463681f81416fb56f818'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:56.383521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1034/2060] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:56 2022] DELETE /identity/v3/users/7880e2b18b64463681f81416fb56f818 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:56.387017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:56.387653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:56.387653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:56.410325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:56.413032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:56.421494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:56.423965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:56.523239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1027/2061] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:56.527561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e69e5-95c8-4e5f-a987-faabbf8bcbba admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:56.531807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:56.532912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:56.533401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:56.539866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:56.543743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:56.543942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:56.547537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:56.620296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:56.644053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f0141-3fa6-458e-a2c9-644a411beb07 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:56.647287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:56.650122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:56.651568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:56.652603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:56.652931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:56.653381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:56.665041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1035/2062] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:56.667387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:56.673942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:56.674841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:56.690879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1028/2063] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:57.109390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:57.111542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:57.140063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1e197-8e47-4919-aa18-960e529c8c47 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:57.151059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:57.152205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:57.152511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:57.152795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] PATH_INFO: `/v3/projects/37e76bd889d4401288ee56ec7f48bb3f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:57.154479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e76bd889d4401288ee56ec7f48bb3f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:57.156872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:57.233995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e76bd889d4401288ee56ec7f48bb3f', 'request_id': 'req-13f60ad0-1429-434b-9103-838938b5956e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.247110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e76bd889d4401288ee56ec7f48bb3f', 'request_id': 'req-13f60ad0-1429-434b-9103-838938b5956e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.262012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e76bd889d4401288ee56ec7f48bb3f', 'request_id': 'req-13f60ad0-1429-434b-9103-838938b5956e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.285452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] The token cache is being invalidate because project 37e76bd889d4401288ee56ec7f48bb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:57.286124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.287479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.290922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1036/2064] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:57 2022] DELETE /identity/v3/projects/37e76bd889d4401288ee56ec7f48bb3f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:57.295157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:57.311617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad6de0-731a-44cc-abf4-e7f2c2165619 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:57.408454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:57.409544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:57.410022 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:57.410530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] PATH_INFO: `/v3/users/8a83ad2b77cf40d09daa06db1147abba` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:57.412838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a83ad2b77cf40d09daa06db1147abba)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:57.416661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:57.487876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a83ad2b77cf40d09daa06db1147abba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.510189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a83ad2b77cf40d09daa06db1147abba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.511155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a83ad2b77cf40d09daa06db1147abba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.511967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a83ad2b77cf40d09daa06db1147abba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.522495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a83ad2b77cf40d09daa06db1147abba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:57.551301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:57.553169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:57.555036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1029/2065] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:04:57 2022] DELETE /identity/v3/users/8a83ad2b77cf40d09daa06db1147abba => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:57.654745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60ad0-1429-434b-9103-838938b5956e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:57.784076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde7348-2981-4dbd-a999-a04ebb5e6a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:57.785603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7348-2981-4dbd-a999-a04ebb5e6a8b service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:57.786286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7348-2981-4dbd-a999-a04ebb5e6a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:57.787094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7348-2981-4dbd-a999-a04ebb5e6a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:57.792287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-edde7348-2981-4dbd-a999-a04ebb5e6a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:57.881649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:57.938804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde7348-2981-4dbd-a999-a04ebb5e6a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:57.940320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde7348-2981-4dbd-a999-a04ebb5e6a8b service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:57.952546 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1037/2066] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:04:58.073621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.075226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:58.176252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14343-c997-447c-b27c-4b2016a9a934 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.182839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.183507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.183793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.184070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] PATH_INFO: `/v3/projects/719ee08cba194f35a2c5d962cf1b18a8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.185294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719ee08cba194f35a2c5d962cf1b18a8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.187277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.207120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:58.248207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719ee08cba194f35a2c5d962cf1b18a8', 'request_id': 'req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:58.260666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719ee08cba194f35a2c5d962cf1b18a8', 'request_id': 'req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:58.269767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719ee08cba194f35a2c5d962cf1b18a8', 'request_id': 'req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:58.284086 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] The token cache is being invalidate because project 719ee08cba194f35a2c5d962cf1b18a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:04:58.284362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:58.285033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1e1ff362-8b8d-4f98-9cf5-65f025a9ef73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:04:58.286696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1030/2067] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:04:58 2022] DELETE /identity/v3/projects/719ee08cba194f35a2c5d962cf1b18a8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:58.295437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131fc1-44ab-4992-a18f-ab9fd1631a3a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.295877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131fc1-44ab-4992-a18f-ab9fd1631a3a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.296269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73131fc1-44ab-4992-a18f-ab9fd1631a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.321219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-73131fc1-44ab-4992-a18f-ab9fd1631a3a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:58.323007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-73131fc1-44ab-4992-a18f-ab9fd1631a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:58.388780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1038/2068] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:58.396837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e979-773b-4786-96ef-d6a95f05c713 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.397133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e979-773b-4786-96ef-d6a95f05c713 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.397414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e979-773b-4786-96ef-d6a95f05c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.419738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4537e979-773b-4786-96ef-d6a95f05c713 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:58.420911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4537e979-773b-4786-96ef-d6a95f05c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:58.429020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1031/2069] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:58.433964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73131fc1-44ab-4992-a18f-ab9fd1631a3a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.443939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73131fc1-44ab-4992-a18f-ab9fd1631a3a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.448676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.449296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.449579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.449852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.450609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:04:58.450910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.452503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.464314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1039/2070] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:04:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:04:58.469124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e979-773b-4786-96ef-d6a95f05c713 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.479430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e979-773b-4786-96ef-d6a95f05c713 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.484300 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.484926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.485212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.485549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.486358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.488348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.522166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1032/2071] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:58 2022] POST /identity/v3/projects => generated 378 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:58.527435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.537701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e834c3-7e58-421e-89d4-9eb2d6c9d7c8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.600952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.602091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.602458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.602790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.603478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.605410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.634341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1040/2072] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:58 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:04:58.636299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.651591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2432-f36e-4576-8423-37b9de1cd830 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.656362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.657094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.657388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.657722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.658444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.660162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.671126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1033/2073] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:58 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:04:58.675211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.687918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35895625-1321-48e6-a072-8baeef18bd14 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.692861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f05ca-1a6d-428f-a2c8-067d0839c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.693482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f05ca-1a6d-428f-a2c8-067d0839c258 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.693767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f05ca-1a6d-428f-a2c8-067d0839c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.694045 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f05ca-1a6d-428f-a2c8-067d0839c258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.694781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f05ca-1a6d-428f-a2c8-067d0839c258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.696426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f05ca-1a6d-428f-a2c8-067d0839c258 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.708316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1041/2074] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:58 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:58.712641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.723891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04205d0a-4445-4e26-ab74-7cf91d95c870 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.731456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.732127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.732405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.732707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] PATH_INFO: `/v3/projects/c6d9837c27994ce3aa6258567768c333/users/3044810c971649078210520a03807486/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.748721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d9837c27994ce3aa6258567768c333, user_id=3044810c971649078210520a03807486, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.751740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:58.765276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1034/2075] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:58 2022] PUT /identity/v3/projects/c6d9837c27994ce3aa6258567768c333/users/3044810c971649078210520a03807486/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:58.777093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42660c2b-9688-4304-963d-c3f9bffab523 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.777603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42660c2b-9688-4304-963d-c3f9bffab523 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.777603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42660c2b-9688-4304-963d-c3f9bffab523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.805901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-42660c2b-9688-4304-963d-c3f9bffab523 None None] MFA Rules not processed for user `3044810c971649078210520a03807486`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:58.807208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-42660c2b-9688-4304-963d-c3f9bffab523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:58.839780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:58.889080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1042/2076] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:58.893714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:58.980812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e672d5a-f340-42c6-9c4c-1cb54290d34e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:58.986156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:58.986899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:58.987278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:58.987565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:58.988343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:58.990497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.021485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1035/2077] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:58 2022] POST /identity/v3/projects => generated 378 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:59.026345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42660c2b-9688-4304-963d-c3f9bffab523 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.037850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42660c2b-9688-4304-963d-c3f9bffab523 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.108705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.109537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.109914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.110299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.111628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.114161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.148271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1043/2078] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:59 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:59.152887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.167913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bf85-b986-447d-aa87-e2ba3cc43b9d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.174368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.175012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.175316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.175582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.176289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.178594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.192909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1036/2079] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:59 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:59.205380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.221929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28308b4-49e0-4590-b712-706ab87407bd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.233637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c8327-1feb-495a-8f32-661fda2ba039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.234550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8327-1feb-495a-8f32-661fda2ba039 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.234751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8327-1feb-495a-8f32-661fda2ba039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.235088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8327-1feb-495a-8f32-661fda2ba039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.235935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8327-1feb-495a-8f32-661fda2ba039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.238060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8327-1feb-495a-8f32-661fda2ba039 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.267602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1044/2080] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:59 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:59.268837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.282408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5816a9-f3ec-4024-8eb3-3b41d15f47e0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.289857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.290582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.290878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.291164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] PATH_INFO: `/v3/projects/d5d5798f5ad7453cb7b6f9ce04916fd7/users/16db70fddeac40a782bfce8406942f67/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.304059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:59.313123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d5798f5ad7453cb7b6f9ce04916fd7, user_id=16db70fddeac40a782bfce8406942f67, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.322765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.349431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1037/2081] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:59 2022] PUT /identity/v3/projects/d5d5798f5ad7453cb7b6f9ce04916fd7/users/16db70fddeac40a782bfce8406942f67/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:04:59.364353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae2dfd-7b97-401c-b524-c279c07cb401 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.364715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae2dfd-7b97-401c-b524-c279c07cb401 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.365004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae2dfd-7b97-401c-b524-c279c07cb401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.404786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c0ae2dfd-7b97-401c-b524-c279c07cb401 None None] MFA Rules not processed for user `16db70fddeac40a782bfce8406942f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:04:59.405765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c0ae2dfd-7b97-401c-b524-c279c07cb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:59.450112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.452967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:59.582794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1045/2082] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:04:59.584636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae2dfd-7b97-401c-b524-c279c07cb401 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.589439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0d63e-d9bc-4b4b-8173-89718d493541 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.597518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.598702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.599481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.600858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.604362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:04:59.630535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:04:59.675929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae2dfd-7b97-401c-b524-c279c07cb401 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.685482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.686232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.686942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.687229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.687472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.687582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.689318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.692968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.699291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1038/2083] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:04:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:04:59.730976 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1046/2084] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:04:59 2022] POST /identity/v3/projects => generated 380 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:59.736454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.751515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb80ea-f4cd-49f1-9a12-8e2a4891bda8 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.841388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.842065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.842388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.842669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.843398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.845389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.879504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1039/2085] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:04:59 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:04:59.885507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.900476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f88ee1-341e-474b-b8f6-2c9dc15f2c1f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.906183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.906857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.907138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.907414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.908156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.909771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.924562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1047/2086] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:59 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:04:59.928671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:04:59.939893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90939a3-0902-40f2-8eaa-46c7a6ef1595 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:04:59.946946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:04:59.947932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:04:59.948373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:04:59.948891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] PATH_INFO: `/v3/projects/688553562f434cf7b6633aedc676371e/users/3122198d5f3048a6b1595e7bcdd03b45/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:04:59.969209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=688553562f434cf7b6633aedc676371e, user_id=3122198d5f3048a6b1595e7bcdd03b45, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:04:59.972192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:04:59.988343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1040/2087] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:04:59 2022] PUT /identity/v3/projects/688553562f434cf7b6633aedc676371e/users/3122198d5f3048a6b1595e7bcdd03b45/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:04:59.992481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:00.004229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae4b39-3c86-4580-ac31-463fe416283a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:00.100108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb69d6-e9bb-41f7-ad41-ce649dbc2381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:00.100741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb69d6-e9bb-41f7-ad41-ce649dbc2381 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:00.101036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb69d6-e9bb-41f7-ad41-ce649dbc2381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:00.101357 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb69d6-e9bb-41f7-ad41-ce649dbc2381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:00.102087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb69d6-e9bb-41f7-ad41-ce649dbc2381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:00.103790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb69d6-e9bb-41f7-ad41-ce649dbc2381 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:00.114357 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1048/2088] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:04:59 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:00.118922 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:00.125658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:00.130393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936059f-2f5b-4293-9744-727576638ebf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:00.137688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:00.138416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:00.138710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:00.138989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] PATH_INFO: `/v3/projects/688553562f434cf7b6633aedc676371e/users/3122198d5f3048a6b1595e7bcdd03b45/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:00.140979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688553562f434cf7b6633aedc676371e, user_id=3122198d5f3048a6b1595e7bcdd03b45, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:00.143751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:00.156203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1041/2089] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:00 2022] PUT /identity/v3/projects/688553562f434cf7b6633aedc676371e/users/3122198d5f3048a6b1595e7bcdd03b45/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:00.167366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79db4b-b9c9-4ff8-8074-ca6349eff201 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:00.167657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79db4b-b9c9-4ff8-8074-ca6349eff201 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:00.167944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79db4b-b9c9-4ff8-8074-ca6349eff201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:00.199738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd79db4b-b9c9-4ff8-8074-ca6349eff201 None None] MFA Rules not processed for user `3122198d5f3048a6b1595e7bcdd03b45`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:00.200987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd79db4b-b9c9-4ff8-8074-ca6349eff201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:00.285771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1049/2090] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:00.298827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:00.300912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:00.382445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54310eb4-a4b1-4b61-9b6b-679194883777 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:00.390422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597cfc3-f24d-443b-8f06-b2855830daa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:00.391492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cfc3-f24d-443b-8f06-b2855830daa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:00.392002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cfc3-f24d-443b-8f06-b2855830daa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:00.392719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cfc3-f24d-443b-8f06-b2855830daa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:00.408860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597cfc3-f24d-443b-8f06-b2855830daa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:00.411440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597cfc3-f24d-443b-8f06-b2855830daa6 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:00.428189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1042/2091] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:00.476785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79db4b-b9c9-4ff8-8074-ca6349eff201 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:00.487086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79db4b-b9c9-4ff8-8074-ca6349eff201 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:00.490759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:00.491397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:00.491679 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:00.492475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:00.522504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:00.555418 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:00.556872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:00.566199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1050/2092] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:01.454794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934f48c-fa4b-4451-bbf8-2e9e9cb91237 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:01.455299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934f48c-fa4b-4451-bbf8-2e9e9cb91237 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:01.455411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934f48c-fa4b-4451-bbf8-2e9e9cb91237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:01.475014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f934f48c-fa4b-4451-bbf8-2e9e9cb91237 None None] MFA Rules not processed for user `3c9ed488ac684c3da17e4790476f979e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:01.476255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f934f48c-fa4b-4451-bbf8-2e9e9cb91237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:01.537226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1043/2093] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:02.319310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:02.322830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:02.429077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81555e7-2eeb-44b7-baf8-fb19533dceb7 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:02.438335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:02.439235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:02.439522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:02.439808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] PATH_INFO: `/v3/users/29a7aed83b0d456da3709086f18418ba` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:02.441324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a7aed83b0d456da3709086f18418ba)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:02.443458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:02.508561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a7aed83b0d456da3709086f18418ba'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:02.520458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a7aed83b0d456da3709086f18418ba'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:02.552027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a7aed83b0d456da3709086f18418ba'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:02.553150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a7aed83b0d456da3709086f18418ba'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:02.554057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a7aed83b0d456da3709086f18418ba'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:02.576875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1051/2094] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:02 2022] DELETE /identity/v3/users/29a7aed83b0d456da3709086f18418ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:02.582466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:02.583163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:02.583163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:02.615689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:02.617038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:02.713283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1044/2095] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:05:02.726249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:02.728743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:02.815433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:02.824580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1eb28-7c23-45f2-b41d-b16da95146e2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:02.834482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:02.835340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:02.836066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:02.836326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:02.847340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:02.849001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:02.861156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1052/2096] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:03.224557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:03.227814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:03.260755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77ea5d-5c7a-42f1-8a3f-bf5f4b2af0ba None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:03.275637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:03.276519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:03.276842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:03.277124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] PATH_INFO: `/v3/projects/e947fa68bf6d41a49ff62ac1745e2db8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:03.278452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e947fa68bf6d41a49ff62ac1745e2db8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:03.280609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:03.402770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:03.431562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e947fa68bf6d41a49ff62ac1745e2db8', 'request_id': 'req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.441380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e947fa68bf6d41a49ff62ac1745e2db8', 'request_id': 'req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.457248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e947fa68bf6d41a49ff62ac1745e2db8', 'request_id': 'req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.485528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] The token cache is being invalidate because project e947fa68bf6d41a49ff62ac1745e2db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:03.486162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.487117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.491964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1045/2097] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:03 2022] DELETE /identity/v3/projects/e947fa68bf6d41a49ff62ac1745e2db8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:03.493295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:03.508435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fccd6-c916-41d2-822d-88119c24ccca service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:03.608646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:03.609319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:03.609590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:03.609868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] PATH_INFO: `/v3/users/9a440b8f0f7f4aaaa04b83a826bde193` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:03.611153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a440b8f0f7f4aaaa04b83a826bde193)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:03.613922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:03.684131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a440b8f0f7f4aaaa04b83a826bde193'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.699389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a440b8f0f7f4aaaa04b83a826bde193'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.715736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a440b8f0f7f4aaaa04b83a826bde193'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.716493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a440b8f0f7f4aaaa04b83a826bde193'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.717178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a440b8f0f7f4aaaa04b83a826bde193'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:03.734068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1053/2098] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:03 2022] DELETE /identity/v3/users/9a440b8f0f7f4aaaa04b83a826bde193 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:04.050931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:04.052558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:04.072231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdc25-87d8-46cb-92be-3d1ca5cab7ee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:04.182943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:04.183667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:04.184055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:04.184339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] PATH_INFO: `/v3/users/3044810c971649078210520a03807486` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:04.185637 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3044810c971649078210520a03807486)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:04.187876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:04.243537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:04.246039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:04.267446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de3208-09f0-45c7-9103-a00895f80b60 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:04.267847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3044810c971649078210520a03807486'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.273168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:04.274667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:04.275329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:04.276069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] PATH_INFO: `/v3/projects/8be9c0f3dbbb43bbb24d3a6cdf70ee82` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:04.278563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be9c0f3dbbb43bbb24d3a6cdf70ee82)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:04.281585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:04.284597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3044810c971649078210520a03807486'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.285617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3044810c971649078210520a03807486'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.286235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3044810c971649078210520a03807486'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.298048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-117666ee-5ab1-4ca5-ac04-91bc9ea9b2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3044810c971649078210520a03807486'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.328057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1046/2099] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:04 2022] DELETE /identity/v3/users/3044810c971649078210520a03807486 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:04.332631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:04.332980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:04.333198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:04.348306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be9c0f3dbbb43bbb24d3a6cdf70ee82', 'request_id': 'req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.356926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be9c0f3dbbb43bbb24d3a6cdf70ee82', 'request_id': 'req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.359229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:04.360650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:04.370233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be9c0f3dbbb43bbb24d3a6cdf70ee82', 'request_id': 'req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.373077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:04.387739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] The token cache is being invalidate because project 8be9c0f3dbbb43bbb24d3a6cdf70ee82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:04.387739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.388379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.391076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1054/2100] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:04 2022] DELETE /identity/v3/projects/8be9c0f3dbbb43bbb24d3a6cdf70ee82 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:04.395499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:04.397967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:04.417247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:04.448918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1047/2101] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:04.457390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:04.459212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:04.505108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fd27b-7067-4e47-8ec3-0ae81fa5c9c8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:04.511082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:04.513165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:04.513686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:04.514178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] PATH_INFO: `/v3/users/a19dbcc3de7a4e6aaebe38f278119d94` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:04.516581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19dbcc3de7a4e6aaebe38f278119d94)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:04.519658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:04.586568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a2852-5281-4271-9b9d-ac88549e7e9a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:04.594753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:04.595632 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:04.596017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:04.596516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:04.611492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:04.613346 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:04.637422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1048/2102] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:04.638908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19dbcc3de7a4e6aaebe38f278119d94'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.647494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19dbcc3de7a4e6aaebe38f278119d94'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.662501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19dbcc3de7a4e6aaebe38f278119d94'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.663347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19dbcc3de7a4e6aaebe38f278119d94'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.664511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19dbcc3de7a4e6aaebe38f278119d94'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:04.683698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1055/2103] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:04 2022] DELETE /identity/v3/users/a19dbcc3de7a4e6aaebe38f278119d94 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:05.403975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:05.420147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df550e1-f8fb-49a3-8317-3d9f6ad0e68d service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:05.523651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:05.524629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:05.524913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:05.525184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] PATH_INFO: `/v3/projects/3540397fb89e4c08a573da5db448cb29` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:05.526542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3540397fb89e4c08a573da5db448cb29)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:05.528523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:05.541833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:05.544121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:05.584306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3d2c-f981-486f-ad85-190c6574b4fb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:05.603741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:05.604891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:05.605380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:05.605871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] PATH_INFO: `/v3/projects/c6d9837c27994ce3aa6258567768c333` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:05.608889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d9837c27994ce3aa6258567768c333)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:05.612602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:05.618041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3540397fb89e4c08a573da5db448cb29', 'request_id': 'req-39ffbf06-0b90-49e7-9ea2-c26e85638141'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.625177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3540397fb89e4c08a573da5db448cb29', 'request_id': 'req-39ffbf06-0b90-49e7-9ea2-c26e85638141'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.635247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3540397fb89e4c08a573da5db448cb29', 'request_id': 'req-39ffbf06-0b90-49e7-9ea2-c26e85638141'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.650235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] The token cache is being invalidate because project 3540397fb89e4c08a573da5db448cb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:05.650810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.651818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.654847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1049/2104] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:05 2022] DELETE /identity/v3/projects/3540397fb89e4c08a573da5db448cb29 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:05.730969 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d9837c27994ce3aa6258567768c333', 'request_id': 'req-4434e4c2-40da-482e-a79d-1766e660d77c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.746021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d9837c27994ce3aa6258567768c333', 'request_id': 'req-4434e4c2-40da-482e-a79d-1766e660d77c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.760835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d9837c27994ce3aa6258567768c333', 'request_id': 'req-4434e4c2-40da-482e-a79d-1766e660d77c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.768461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:05.789842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] The token cache is being invalidate because project c6d9837c27994ce3aa6258567768c333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:05.790462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.791459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:05.793455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1056/2105] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:05 2022] DELETE /identity/v3/projects/c6d9837c27994ce3aa6258567768c333 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:05.799133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:05.800227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:05.827351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:05.924770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffbf06-0b90-49e7-9ea2-c26e85638141 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:06.017998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:06.021723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:06.021723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:06.021723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] PATH_INFO: `/v3/users/16db70fddeac40a782bfce8406942f67` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:06.022418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16db70fddeac40a782bfce8406942f67)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:06.026202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:06.098634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16db70fddeac40a782bfce8406942f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.107847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16db70fddeac40a782bfce8406942f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.108788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16db70fddeac40a782bfce8406942f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.109474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16db70fddeac40a782bfce8406942f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.121700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16db70fddeac40a782bfce8406942f67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.151202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1050/2106] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:05 2022] DELETE /identity/v3/users/16db70fddeac40a782bfce8406942f67 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:06.607522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:06.609565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:06.628171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434e4c2-40da-482e-a79d-1766e660d77c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:06.726051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:06.727723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:06.728143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:06.728571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] PATH_INFO: `/v3/projects/d5d5798f5ad7453cb7b6f9ce04916fd7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:06.730757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d5798f5ad7453cb7b6f9ce04916fd7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:06.734250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:06.803009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d5798f5ad7453cb7b6f9ce04916fd7', 'request_id': 'req-fae0ba95-58b4-469d-a383-d8b7614a5d71'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.814495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d5798f5ad7453cb7b6f9ce04916fd7', 'request_id': 'req-fae0ba95-58b4-469d-a383-d8b7614a5d71'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.823211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d5798f5ad7453cb7b6f9ce04916fd7', 'request_id': 'req-fae0ba95-58b4-469d-a383-d8b7614a5d71'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.837510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] The token cache is being invalidate because project d5d5798f5ad7453cb7b6f9ce04916fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:06.837796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.838494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:06.840699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1057/2107] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:06 2022] DELETE /identity/v3/projects/d5d5798f5ad7453cb7b6f9ce04916fd7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:06.846501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:06.848168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:06.870322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a96a-9e5d-481e-987c-ae82c056f598 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:06.915790 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:06.938526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:06.939406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:06.939793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:06.940079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] PATH_INFO: `/v3/users/3122198d5f3048a6b1595e7bcdd03b45` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:06.941303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3122198d5f3048a6b1595e7bcdd03b45)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:06.943297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:06.996590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3122198d5f3048a6b1595e7bcdd03b45'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.004910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3122198d5f3048a6b1595e7bcdd03b45'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.004910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3122198d5f3048a6b1595e7bcdd03b45'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.005261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3122198d5f3048a6b1595e7bcdd03b45'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.015244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-004b8ebe-ae0f-4e40-921d-3e1b0e4e9018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3122198d5f3048a6b1595e7bcdd03b45'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.033626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1051/2108] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:06 2022] DELETE /identity/v3/users/3122198d5f3048a6b1595e7bcdd03b45 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:07.362224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:07.364165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:07.380398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0ba95-58b4-469d-a383-d8b7614a5d71 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:07.462968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:07.462968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.462968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.463567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] PATH_INFO: `/v3/projects/688553562f434cf7b6633aedc676371e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.465027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] RBAC: Authorizing `identity:delete_project(project_id=688553562f434cf7b6633aedc676371e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:07.467143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:07.524457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:07.551143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688553562f434cf7b6633aedc676371e', 'request_id': 'req-11213585-540c-4b5f-b6e3-13625469466f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.559264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688553562f434cf7b6633aedc676371e', 'request_id': 'req-11213585-540c-4b5f-b6e3-13625469466f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.569060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688553562f434cf7b6633aedc676371e', 'request_id': 'req-11213585-540c-4b5f-b6e3-13625469466f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.581751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] The token cache is being invalidate because project 688553562f434cf7b6633aedc676371e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:07.582140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.583075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-11213585-540c-4b5f-b6e3-13625469466f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:07.588327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1058/2109] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:07 2022] DELETE /identity/v3/projects/688553562f434cf7b6633aedc676371e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:07.596692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd90789-39b1-4c54-8680-cb689aa1d163 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.596692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd90789-39b1-4c54-8680-cb689aa1d163 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.597053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd90789-39b1-4c54-8680-cb689aa1d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.624747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dbd90789-39b1-4c54-8680-cb689aa1d163 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:07.625990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dbd90789-39b1-4c54-8680-cb689aa1d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:07.699852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1052/2110] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:05:07.708577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792713a9-ac84-4b64-bf5f-27b0bedf9d9e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.709058 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792713a9-ac84-4b64-bf5f-27b0bedf9d9e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.709134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792713a9-ac84-4b64-bf5f-27b0bedf9d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.730420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-792713a9-ac84-4b64-bf5f-27b0bedf9d9e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:07.731653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-792713a9-ac84-4b64-bf5f-27b0bedf9d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:07.740524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1059/2111] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:07.745932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd90789-39b1-4c54-8680-cb689aa1d163 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:07.758596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd90789-39b1-4c54-8680-cb689aa1d163 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:07.764372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:07.766782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.767080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.767468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.768191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:05:07.768506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:07.770152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:07.783440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1053/2112] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:05:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:05:07.788158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792713a9-ac84-4b64-bf5f-27b0bedf9d9e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:07.798345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792713a9-ac84-4b64-bf5f-27b0bedf9d9e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:07.804690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:07.805809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.806157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.806523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.807272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:07.809448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:07.840441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1060/2113] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:07 2022] POST /identity/v3/projects => generated 382 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:07.844756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:07.855265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e21c08-ee15-4dbf-8710-0f823256cca2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:07.913131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:07.932833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:07.933747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.934147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.934532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.935732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:07.938686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:07.962515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1054/2114] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:07 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:07.966992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:07.977859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611bc6c-163c-4079-b130-b71d09e8e36b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:07.982524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:07.983143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:07.983427 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:07.983708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:07.984410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:07.986035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:07.997253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1061/2115] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:07 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:08.001638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:08.013234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370758a-cee0-4b78-953e-804985ccd112 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:08.018678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55133e85-ab46-4f19-9ade-898c276e3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:08.019332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55133e85-ab46-4f19-9ade-898c276e3e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:08.019653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55133e85-ab46-4f19-9ade-898c276e3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:08.019967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55133e85-ab46-4f19-9ade-898c276e3e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:08.020829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55133e85-ab46-4f19-9ade-898c276e3e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:08.022834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55133e85-ab46-4f19-9ade-898c276e3e1a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:08.035154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1055/2116] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:08 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:05:08.040243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:08.050938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccb90c-1b66-4161-ac06-d6e52e3de495 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:08.056534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:08.057344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:08.057636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:08.057922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] PATH_INFO: `/v3/projects/b6e6882965c54c35936404733cf106ac/users/c968f8a113a341a38b24c6f6efef6155/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:08.074086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e6882965c54c35936404733cf106ac, user_id=c968f8a113a341a38b24c6f6efef6155, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:08.076823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:08.090675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1062/2117] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:08 2022] PUT /identity/v3/projects/b6e6882965c54c35936404733cf106ac/users/c968f8a113a341a38b24c6f6efef6155/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:08.103760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb2de-3d1d-4138-add5-82cc87387eab None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:08.104043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb2de-3d1d-4138-add5-82cc87387eab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:08.104321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cb2de-3d1d-4138-add5-82cc87387eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:08.142974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-398cb2de-3d1d-4138-add5-82cc87387eab None None] MFA Rules not processed for user `c968f8a113a341a38b24c6f6efef6155`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:08.144316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-398cb2de-3d1d-4138-add5-82cc87387eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:08.218057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1056/2118] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:08.230983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:08.232745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:08.306908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b164bca-81c9-4550-b9a2-6974e7b949f1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:08.310685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79219cf-0914-4367-8def-427077cb8601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:08.311323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79219cf-0914-4367-8def-427077cb8601 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:08.311610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79219cf-0914-4367-8def-427077cb8601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:08.311911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79219cf-0914-4367-8def-427077cb8601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:08.321049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79219cf-0914-4367-8def-427077cb8601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:08.322538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79219cf-0914-4367-8def-427077cb8601 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:08.332728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1063/2119] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:05:14.045708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cb2de-3d1d-4138-add5-82cc87387eab None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:14.120051 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cb2de-3d1d-4138-add5-82cc87387eab None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:14.125527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:14.126186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:14.126500 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:14.126776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] PATH_INFO: `/v3/users/c968f8a113a341a38b24c6f6efef6155` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:14.127978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c968f8a113a341a38b24c6f6efef6155)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:14.129953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:14.195156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c968f8a113a341a38b24c6f6efef6155'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.206470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c968f8a113a341a38b24c6f6efef6155'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.207573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c968f8a113a341a38b24c6f6efef6155'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.208369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c968f8a113a341a38b24c6f6efef6155'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.213136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:14.221864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c968f8a113a341a38b24c6f6efef6155'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.250338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1057/2120] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:14 2022] DELETE /identity/v3/users/c968f8a113a341a38b24c6f6efef6155 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:14.253547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:14.254004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:14.254146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:14.280619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:14.282248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:14.346192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:14.367895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1064/2121] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:14.378684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:14.381125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:14.471996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db9fe0-2163-4177-a13e-af0a26783c85 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:14.480242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533cd46-dd5e-43b1-98a2-64e3fd962246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:14.481073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533cd46-dd5e-43b1-98a2-64e3fd962246 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:14.481369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533cd46-dd5e-43b1-98a2-64e3fd962246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:14.481706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533cd46-dd5e-43b1-98a2-64e3fd962246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:14.508891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533cd46-dd5e-43b1-98a2-64e3fd962246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:14.510572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533cd46-dd5e-43b1-98a2-64e3fd962246 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:14.524994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1058/2122] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:14.829717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:14.832829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:14.857151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4426cf-6dbc-48d5-9c8e-e10340cf2bf9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:14.863069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:14.864586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:14.864884 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:14.865161 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] PATH_INFO: `/v3/projects/b6e6882965c54c35936404733cf106ac` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:14.866534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e6882965c54c35936404733cf106ac)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:14.869067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:14.933558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e6882965c54c35936404733cf106ac', 'request_id': 'req-2558c505-d11a-4f7c-a160-d15a73fff931'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.940690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e6882965c54c35936404733cf106ac', 'request_id': 'req-2558c505-d11a-4f7c-a160-d15a73fff931'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.951865 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e6882965c54c35936404733cf106ac', 'request_id': 'req-2558c505-d11a-4f7c-a160-d15a73fff931'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.969090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] The token cache is being invalidate because project b6e6882965c54c35936404733cf106ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:14.970349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.971462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2558c505-d11a-4f7c-a160-d15a73fff931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:14.974174 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1065/2123] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:14 2022] DELETE /identity/v3/projects/b6e6882965c54c35936404733cf106ac => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:14.981325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c31b7-b6b9-46db-a2e5-117ded7ab3d0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:14.981612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c31b7-b6b9-46db-a2e5-117ded7ab3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:14.981891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c31b7-b6b9-46db-a2e5-117ded7ab3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.003185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c39c31b7-b6b9-46db-a2e5-117ded7ab3d0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:15.004442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c39c31b7-b6b9-46db-a2e5-117ded7ab3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:15.077428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1059/2124] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:05:15.086580 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06a810-11f9-4264-a00d-36e37ecac9c1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.086869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06a810-11f9-4264-a00d-36e37ecac9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.087155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06a810-11f9-4264-a00d-36e37ecac9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.108472 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ee06a810-11f9-4264-a00d-36e37ecac9c1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:15.109722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee06a810-11f9-4264-a00d-36e37ecac9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:15.119428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1066/2125] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:15.124012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c31b7-b6b9-46db-a2e5-117ded7ab3d0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.135434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c31b7-b6b9-46db-a2e5-117ded7ab3d0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.140387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.141024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.141311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.141592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.142430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:05:15.142738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.144367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.157801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1060/2126] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:05:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:05:15.162311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06a810-11f9-4264-a00d-36e37ecac9c1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.172929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06a810-11f9-4264-a00d-36e37ecac9c1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.177920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.178587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.178873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.179851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.180596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.182714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.211228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1067/2127] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:15 2022] POST /identity/v3/projects => generated 370 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:05:15.215454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.225764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec12903-9ab8-4daa-8067-9561553ca990 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.292344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.292981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.293289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.293565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.294237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.296243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.307439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:15.320982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1061/2128] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:15 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:05:15.325081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.336969 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972a61b-0757-4983-8623-d575925fcc77 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.342343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.342999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.343308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.343607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.344313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.346033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.358496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1068/2129] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:15 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:05:15.362824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.373302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67c88f-601b-4c72-a3c2-bdd81ef8d05b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.378188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd0ec3-401e-4fb3-a0cb-4f953e37138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.378840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0ec3-401e-4fb3-a0cb-4f953e37138a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.379119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0ec3-401e-4fb3-a0cb-4f953e37138a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.379395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0ec3-401e-4fb3-a0cb-4f953e37138a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.380093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd0ec3-401e-4fb3-a0cb-4f953e37138a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.381712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd0ec3-401e-4fb3-a0cb-4f953e37138a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.392692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1062/2130] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:15 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:15.396985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.412740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de87022-a92f-424e-a824-1fcbbcfca7e8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.420204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.421150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.421442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.421772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] PATH_INFO: `/v3/projects/09604afd863b444282f7e462d3ded316/users/1c45ed2c4d1d493faee3a478facf11e1/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.440536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=09604afd863b444282f7e462d3ded316, user_id=1c45ed2c4d1d493faee3a478facf11e1, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.443277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.457124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1069/2131] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:15 2022] PUT /identity/v3/projects/09604afd863b444282f7e462d3ded316/users/1c45ed2c4d1d493faee3a478facf11e1/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:15.469379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aa4df-b34e-4d42-bc2a-a630c2aded38 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.469597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aa4df-b34e-4d42-bc2a-a630c2aded38 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.469881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aa4df-b34e-4d42-bc2a-a630c2aded38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.498368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8e4aa4df-b34e-4d42-bc2a-a630c2aded38 None None] MFA Rules not processed for user `1c45ed2c4d1d493faee3a478facf11e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:15.499527 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e4aa4df-b34e-4d42-bc2a-a630c2aded38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:15.582030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1063/2132] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:15.597067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:15.598925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:15.711606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d3068-f21c-474b-bd10-1a51871195ed admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:15.716141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:15.716842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:15.717277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:15.717678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:15.733484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:15.737522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:15.739439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:15.754099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1070/2133] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:22.277413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:22.279981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:22.280293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:22.303650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:22.305302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:22.375890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1064/2134] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:22.427391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:22.431105 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:22.532680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3267973-65a6-4663-9da9-2cc1fc31709e service glance] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:22.541155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:22.541813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:22.542097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:22.542410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:22.551782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:22.553397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:22.563783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:22.565083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1071/2135] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:05:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:05:22.565550 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:22.656672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088cd8a-9374-4ca1-b642-5a71f00d177b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:22.663040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:22.664840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:22.665357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:22.665804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] PATH_INFO: `/v3/users/7ee529bb6399487eba7c2d339584268f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:22.667449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee529bb6399487eba7c2d339584268f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:22.669827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:22.711034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:22.760860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee529bb6399487eba7c2d339584268f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:22.771056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee529bb6399487eba7c2d339584268f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:22.773171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee529bb6399487eba7c2d339584268f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:22.774088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee529bb6399487eba7c2d339584268f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:22.786066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee529bb6399487eba7c2d339584268f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:22.812997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1065/2136] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:22 2022] DELETE /identity/v3/users/7ee529bb6399487eba7c2d339584268f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:23.153386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:23.168422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900127af-f103-43ea-a9c2-672b5f5c6885 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:23.247260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:23.247830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:23.248170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:23.248545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] PATH_INFO: `/v3/projects/1b71dc36a2944dd09002872cb1f8fc7b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:23.250391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b71dc36a2944dd09002872cb1f8fc7b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:23.251982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:23.313451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b71dc36a2944dd09002872cb1f8fc7b', 'request_id': 'req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.321690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b71dc36a2944dd09002872cb1f8fc7b', 'request_id': 'req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.341135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b71dc36a2944dd09002872cb1f8fc7b', 'request_id': 'req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.354852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] The token cache is being invalidate because project 1b71dc36a2944dd09002872cb1f8fc7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:23.355144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.356090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.358408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1072/2137] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:23 2022] DELETE /identity/v3/projects/1b71dc36a2944dd09002872cb1f8fc7b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:23.369273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:23.370840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:23.385132 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56978593-27e0-4f2a-9b0c-1ed8f018d360 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:23.455038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:23.455729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:23.456014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:23.456288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] PATH_INFO: `/v3/users/6b7c7caa7fd1480796c3de9d20c860e4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:23.457578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7c7caa7fd1480796c3de9d20c860e4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:23.459667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:23.582045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7c7caa7fd1480796c3de9d20c860e4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.598832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7c7caa7fd1480796c3de9d20c860e4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.599777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7c7caa7fd1480796c3de9d20c860e4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.600523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7c7caa7fd1480796c3de9d20c860e4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.611890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e139208f-d925-48c6-8ac7-0d9fc1d314d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7c7caa7fd1480796c3de9d20c860e4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:23.645287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1066/2138] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:23 2022] DELETE /identity/v3/users/6b7c7caa7fd1480796c3de9d20c860e4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:23.884666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:23.887513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:23.904564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b83f5-54c7-4529-ac5a-9bcae5c1e3ca admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:23.926387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:24.007301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:24.008431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.009305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.009918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] PATH_INFO: `/v3/projects/ce4db73c71004754865aa0aec45618d8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.011852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4db73c71004754865aa0aec45618d8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:24.015243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:24.091945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4db73c71004754865aa0aec45618d8', 'request_id': 'req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:24.104401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4db73c71004754865aa0aec45618d8', 'request_id': 'req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:24.114220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4db73c71004754865aa0aec45618d8', 'request_id': 'req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:24.129096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] The token cache is being invalidate because project ce4db73c71004754865aa0aec45618d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:24.129327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:24.130144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-12e97bf3-ad0b-41e6-a146-6009df4cdd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:24.132260 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1073/2139] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:23 2022] DELETE /identity/v3/projects/ce4db73c71004754865aa0aec45618d8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:24.137590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d3ff-5f8b-4cf8-b57a-dfc5460c54e1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.137884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d3ff-5f8b-4cf8-b57a-dfc5460c54e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.138187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d3ff-5f8b-4cf8-b57a-dfc5460c54e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.204817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-17d7d3ff-5f8b-4cf8-b57a-dfc5460c54e1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:24.207249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17d7d3ff-5f8b-4cf8-b57a-dfc5460c54e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:24.239841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:24.319418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1067/2140] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:24.328131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6534-6609-4067-8856-da91e50cd7b8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.328423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6534-6609-4067-8856-da91e50cd7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.328706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f6534-6609-4067-8856-da91e50cd7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.354959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-767f6534-6609-4067-8856-da91e50cd7b8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:24.357747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-767f6534-6609-4067-8856-da91e50cd7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:24.381499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1074/2141] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:24.383300 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d3ff-5f8b-4cf8-b57a-dfc5460c54e1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:24.393668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d3ff-5f8b-4cf8-b57a-dfc5460c54e1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:24.401053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:24.401751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.402048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.402354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.403114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:05:24.403360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:24.405626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:24.419954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1068/2142] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:05:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:05:24.424396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f6534-6609-4067-8856-da91e50cd7b8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:24.434732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f6534-6609-4067-8856-da91e50cd7b8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:24.439728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:24.440378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.440663 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.440980 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.441658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:24.443689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:24.475637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1075/2143] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:24 2022] POST /identity/v3/projects => generated 384 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:24.481763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:24.500229 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fc9df-af97-427c-adaf-6164280e3d5a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:24.606082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:24.606803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.607459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.607459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.608007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:24.609982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:24.648241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1069/2144] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:24 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:24.649378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:24.662844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ff683-9335-4f09-a255-47042f487a5f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:24.668917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:24.669576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.669867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.670157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.670924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:24.672618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:24.686433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1076/2145] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:24 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:24.696737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:24.712980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfffa2-073d-4f27-a2b2-06ac8ed6c7ac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:24.719519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c50fd-73ed-4add-ae1b-560e95e06d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:24.720454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c50fd-73ed-4add-ae1b-560e95e06d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.720963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c50fd-73ed-4add-ae1b-560e95e06d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.720963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c50fd-73ed-4add-ae1b-560e95e06d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.721648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c50fd-73ed-4add-ae1b-560e95e06d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:24.723158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c50fd-73ed-4add-ae1b-560e95e06d82 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:24.737918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1070/2146] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:24 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:24.743082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:24.760651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7715d7-1797-4dd9-92ba-d9b8e075faa9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:24.766144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:24.767107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.767381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.767808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] PATH_INFO: `/v3/projects/f83020a81425441ba0f64071c2da158e/users/77da8ea348ca49f8b7e0063ef779beb8/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.788971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83020a81425441ba0f64071c2da158e, user_id=77da8ea348ca49f8b7e0063ef779beb8, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:24.792642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:24.822352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1077/2147] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:24 2022] PUT /identity/v3/projects/f83020a81425441ba0f64071c2da158e/users/77da8ea348ca49f8b7e0063ef779beb8/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:24.833205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b181ed-da53-4547-89df-1f2cefa2adae None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:24.834816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b181ed-da53-4547-89df-1f2cefa2adae None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:24.835162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b181ed-da53-4547-89df-1f2cefa2adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:24.880504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-54b181ed-da53-4547-89df-1f2cefa2adae None None] MFA Rules not processed for user `77da8ea348ca49f8b7e0063ef779beb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:24.887115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-54b181ed-da53-4547-89df-1f2cefa2adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:24.985663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1071/2148] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:24.990524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.080364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:25.105528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ecc4c-416b-4750-8c51-e93f36f64321 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.112244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.113017 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.113305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.113578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.114446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:25.116616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:25.162944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1078/2149] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:24 2022] POST /identity/v3/projects => generated 386 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:05:25.167551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b181ed-da53-4547-89df-1f2cefa2adae None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.184546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b181ed-da53-4547-89df-1f2cefa2adae None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.206060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:25.282505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.283208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.283919 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.283919 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.284600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:25.286824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:25.319166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1072/2150] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:25 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:25.329027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.360948 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b3b93-eb57-437b-8f8d-8c88018e5e47 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.373326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.374841 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.375483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.376389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.378250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:25.382490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:25.423626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1079/2151] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:25 2022] GET /identity/v3/roles => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:25.425497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.443331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767ac1-7cf8-40ee-bc96-8f1e487ce3d8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.451751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.453251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.454853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.455816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] PATH_INFO: `/v3/projects/ddea99d2792b47698074417d4e837cb2/users/4bf97517dbc346f6bac8624b462d0ae7/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.486282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddea99d2792b47698074417d4e837cb2, user_id=4bf97517dbc346f6bac8624b462d0ae7, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:25.491681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:25.518349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1073/2152] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:25 2022] PUT /identity/v3/projects/ddea99d2792b47698074417d4e837cb2/users/4bf97517dbc346f6bac8624b462d0ae7/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:25.522374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.541027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073294f-edd9-4870-adec-bcc114ae4e48 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.658556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714a7a-77c4-4a86-943a-18763be3bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.659189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714a7a-77c4-4a86-943a-18763be3bfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.659475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714a7a-77c4-4a86-943a-18763be3bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.659798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714a7a-77c4-4a86-943a-18763be3bfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.660726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf714a7a-77c4-4a86-943a-18763be3bfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:25.662382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf714a7a-77c4-4a86-943a-18763be3bfc1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:25.683286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1080/2153] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:25 2022] GET /identity/v3/roles => generated 1427 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:25.690630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.703021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11925b-3ab5-457f-bb05-7c47b2b178f1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.707693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.708383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.708994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.709123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] PATH_INFO: `/v3/projects/ddea99d2792b47698074417d4e837cb2/users/4bf97517dbc346f6bac8624b462d0ae7/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.711895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddea99d2792b47698074417d4e837cb2, user_id=4bf97517dbc346f6bac8624b462d0ae7, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:25.715274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:25.727601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1074/2154] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:25 2022] PUT /identity/v3/projects/ddea99d2792b47698074417d4e837cb2/users/4bf97517dbc346f6bac8624b462d0ae7/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:25.740219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.740825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.741763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:25.774920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] MFA Rules not processed for user `4bf97517dbc346f6bac8624b462d0ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:25.776565 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:25.854977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1081/2155] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:25.868729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:25.871745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:25.985648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b6c9b-c6e2-442a-a529-73209c715438 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:25.989640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8ff6d-6707-4761-ba55-2411e28bdf3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:25.990371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8ff6d-6707-4761-ba55-2411e28bdf3a service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:25.990772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8ff6d-6707-4761-ba55-2411e28bdf3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:25.991050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8ff6d-6707-4761-ba55-2411e28bdf3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:26.063677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8ff6d-6707-4761-ba55-2411e28bdf3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:26.065189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8ff6d-6707-4761-ba55-2411e28bdf3a service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:26.076183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1075/2156] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:30.815084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:30.817054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:30.831036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9cfe9-0e2f-420d-863b-b5d76bed0ec3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:30.835669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:30.836298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:30.836581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:30.836858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:30.846325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:30.847779 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:30.860405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1082/2157] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:34.625248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1921ba-fab4-4463-874a-e5b9f2e53f3f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:34.625980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1921ba-fab4-4463-874a-e5b9f2e53f3f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:34.625980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1921ba-fab4-4463-874a-e5b9f2e53f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:34.649287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4a1921ba-fab4-4463-874a-e5b9f2e53f3f None None] MFA Rules not processed for user `b125e48efd9c4907be550b3f4077134c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:34.651464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4a1921ba-fab4-4463-874a-e5b9f2e53f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:34.691377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:34.766830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1076/2158] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:36.043632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:36.073559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:36.121355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6144d8-2457-412b-b55c-575a547b5415 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:36.127386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:36.128362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:36.128649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:36.128932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] PATH_INFO: `/v3/users/77da8ea348ca49f8b7e0063ef779beb8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:36.130175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77da8ea348ca49f8b7e0063ef779beb8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:36.132854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:36.282609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77da8ea348ca49f8b7e0063ef779beb8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:36.301972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77da8ea348ca49f8b7e0063ef779beb8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:36.329437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77da8ea348ca49f8b7e0063ef779beb8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:36.330516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77da8ea348ca49f8b7e0063ef779beb8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:36.331277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77da8ea348ca49f8b7e0063ef779beb8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:36.354893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1083/2159] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:36 2022] DELETE /identity/v3/users/77da8ea348ca49f8b7e0063ef779beb8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:36.360617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:36.361650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:36.362099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:36.395136 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:36.397482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:36.486306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1077/2160] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:05:36.497221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:36.499112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:36.587115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6ba4d-2dd1-428a-8ecc-f7ae8db697d7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:36.591449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:36.592290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:36.592596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:36.593089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:36.604438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:36.606651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:36.620905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1084/2161] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:36.986728 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:36.990337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:37.024130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5055e-4d48-4f00-91fb-0b0fe68940bd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:37.031191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:37.032215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:37.032525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:37.032801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] PATH_INFO: `/v3/projects/f83020a81425441ba0f64071c2da158e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:37.034377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83020a81425441ba0f64071c2da158e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:37.036804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:37.115233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83020a81425441ba0f64071c2da158e', 'request_id': 'req-01530163-4b87-4ac6-88b9-9e76c4653f20'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.122238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83020a81425441ba0f64071c2da158e', 'request_id': 'req-01530163-4b87-4ac6-88b9-9e76c4653f20'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.144282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83020a81425441ba0f64071c2da158e', 'request_id': 'req-01530163-4b87-4ac6-88b9-9e76c4653f20'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.163931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] The token cache is being invalidate because project f83020a81425441ba0f64071c2da158e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:37.164565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.165262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.167612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1078/2162] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:36 2022] DELETE /identity/v3/projects/f83020a81425441ba0f64071c2da158e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:37.172354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:37.184942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8fa1-c549-4d24-9bcc-39e59c65b467 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:37.254197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:37.267366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:37.268905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:37.269199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:37.269510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] PATH_INFO: `/v3/users/4bf97517dbc346f6bac8624b462d0ae7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:37.270859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf97517dbc346f6bac8624b462d0ae7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:37.273348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:37.330439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf97517dbc346f6bac8624b462d0ae7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.338208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf97517dbc346f6bac8624b462d0ae7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.353997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf97517dbc346f6bac8624b462d0ae7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.354836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf97517dbc346f6bac8624b462d0ae7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.355619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7fdff52d-d09a-4934-8a97-d0b75cc4cc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf97517dbc346f6bac8624b462d0ae7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.373327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1085/2163] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:37 2022] DELETE /identity/v3/users/4bf97517dbc346f6bac8624b462d0ae7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:37.705617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:37.708065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:37.722930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530163-4b87-4ac6-88b9-9e76c4653f20 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:37.808246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:37.831823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:37.833103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:37.833588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:37.834046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] PATH_INFO: `/v3/projects/ddea99d2792b47698074417d4e837cb2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:37.836120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddea99d2792b47698074417d4e837cb2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:37.838547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:37.906540 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddea99d2792b47698074417d4e837cb2', 'request_id': 'req-92972383-4738-42ce-beb0-0a9634ceb734'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.913378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddea99d2792b47698074417d4e837cb2', 'request_id': 'req-92972383-4738-42ce-beb0-0a9634ceb734'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.923038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddea99d2792b47698074417d4e837cb2', 'request_id': 'req-92972383-4738-42ce-beb0-0a9634ceb734'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.937496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] The token cache is being invalidate because project ddea99d2792b47698074417d4e837cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:37.937914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.938623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-92972383-4738-42ce-beb0-0a9634ceb734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:37.940190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1079/2164] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:37 2022] DELETE /identity/v3/projects/ddea99d2792b47698074417d4e837cb2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:37.948600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b168e-ea9b-4074-a8cd-e7a2c1aff9d1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:37.948967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b168e-ea9b-4074-a8cd-e7a2c1aff9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:37.949426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b168e-ea9b-4074-a8cd-e7a2c1aff9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:37.979585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0c7b168e-ea9b-4074-a8cd-e7a2c1aff9d1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:37.981352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0c7b168e-ea9b-4074-a8cd-e7a2c1aff9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:38.124664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5e3b4-bb28-4b52-bc5e-9e7c29e4bb9f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.124991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5e3b4-bb28-4b52-bc5e-9e7c29e4bb9f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.125245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5e3b4-bb28-4b52-bc5e-9e7c29e4bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:38.157430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1086/2165] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:38.175750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bcd5e3b4-bb28-4b52-bc5e-9e7c29e4bb9f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:38.178279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bcd5e3b4-bb28-4b52-bc5e-9e7c29e4bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:38.193565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1080/2166] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:38.199572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b168e-ea9b-4074-a8cd-e7a2c1aff9d1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:38.213451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b168e-ea9b-4074-a8cd-e7a2c1aff9d1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:38.250739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:38.251751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.253242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.253607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:38.254815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:05:38.255080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:38.260014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:38.290587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1087/2167] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:05:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:05:38.298061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5e3b4-bb28-4b52-bc5e-9e7c29e4bb9f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:38.309501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5e3b4-bb28-4b52-bc5e-9e7c29e4bb9f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:38.321891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:38.322664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.323040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.323469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:38.324475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:38.327794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:38.403895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1081/2168] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:38 2022] POST /identity/v3/projects => generated 376 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:38.405264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:38.432068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b01a-557a-4cb7-9914-1997cb2501f4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:38.595689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:38.621487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:38.622692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.622692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.624297 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:38.625425 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:38.631043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:38.666217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1088/2169] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:38 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:38.673193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:38.710633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ee88-a75d-45f9-924d-f85a86297fc1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:38.728650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:38.729319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.729795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.730085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:38.730899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:38.732827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:38.776202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1082/2170] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:38 2022] GET /identity/v3/roles => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:05:38.781286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:38.813421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6985f2-bad2-481f-bbd8-06b3055df508 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:38.833259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64345ac-10ea-4605-98fd-782a019cce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:38.836022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64345ac-10ea-4605-98fd-782a019cce5d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.836803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64345ac-10ea-4605-98fd-782a019cce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.837135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64345ac-10ea-4605-98fd-782a019cce5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:38.838753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64345ac-10ea-4605-98fd-782a019cce5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:38.842056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64345ac-10ea-4605-98fd-782a019cce5d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:38.863613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1089/2171] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:38 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:38.868191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:38.882396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0f35d-c509-4cb3-8426-ac4d0aea2315 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:38.892801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:38.893529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.893825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.894112 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] PATH_INFO: `/v3/projects/c8416938e0a146e4bcb5b21331ae494f/users/6447d80f15f042d1a2b472806a214a5a/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:38.922554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8416938e0a146e4bcb5b21331ae494f, user_id=6447d80f15f042d1a2b472806a214a5a, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:38.926283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:38.950305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1083/2172] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:38 2022] PUT /identity/v3/projects/c8416938e0a146e4bcb5b21331ae494f/users/6447d80f15f042d1a2b472806a214a5a/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:38.965816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c20a07-96f2-4bad-a117-9f65394ec3a0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:38.965816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c20a07-96f2-4bad-a117-9f65394ec3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:38.965816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c20a07-96f2-4bad-a117-9f65394ec3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:39.042734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-97c20a07-96f2-4bad-a117-9f65394ec3a0 None None] MFA Rules not processed for user `6447d80f15f042d1a2b472806a214a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:39.044538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-97c20a07-96f2-4bad-a117-9f65394ec3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:39.244538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1090/2173] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:39.245376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:39.362207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43360ff3-af75-4db2-be58-bacb7b47a1ee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:39.369968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:39.371103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:39.374865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:39.375207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:39.376085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:39.378369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:39.402035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:39.411098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1084/2174] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:39 2022] POST /identity/v3/projects => generated 376 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:39.415071 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c20a07-96f2-4bad-a117-9f65394ec3a0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:39.426344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c20a07-96f2-4bad-a117-9f65394ec3a0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:39.517547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:39.518930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:39.519781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:39.520442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:39.521702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:39.525791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:39.550738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1091/2175] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:39 2022] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:39.560608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:39.573261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb4edb-bb57-4118-ac08-95c1e1a70fb2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:39.578560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:39.579328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:39.579608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:39.579882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:39.580596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:39.582378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:39.602201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1085/2176] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:39 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:39.602444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:39.613454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286a640-548c-47d7-96f9-27b2e03d02cd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:39.625379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:39.626622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:39.627121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:39.627638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] PATH_INFO: `/v3/projects/1720daa4225d40319db786a3066ae901/users/8a07dc4a3a5b48b19de21752fe420031/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:39.657520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1720daa4225d40319db786a3066ae901, user_id=8a07dc4a3a5b48b19de21752fe420031, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:39.660456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:39.685837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1092/2177] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:39 2022] PUT /identity/v3/projects/1720daa4225d40319db786a3066ae901/users/8a07dc4a3a5b48b19de21752fe420031/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:39.689789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:39.703473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dad1cc-c100-4d10-8ecb-f00294ee5d55 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:39.772539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccfc32-c7c3-4a57-b512-60c460f5ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:39.773252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfc32-c7c3-4a57-b512-60c460f5ec0d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:39.773493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfc32-c7c3-4a57-b512-60c460f5ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:39.773992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccfc32-c7c3-4a57-b512-60c460f5ec0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:39.774827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccfc32-c7c3-4a57-b512-60c460f5ec0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:39.776627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccfc32-c7c3-4a57-b512-60c460f5ec0d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:39.794661 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:39.802308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1086/2178] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:39 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:39.810646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b90b0-b12e-4a7c-bc21-28dc4a2b8c2b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:39.824646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:39.825440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:39.825730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:39.826008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] PATH_INFO: `/v3/projects/1720daa4225d40319db786a3066ae901/users/8a07dc4a3a5b48b19de21752fe420031/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:39.837467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1720daa4225d40319db786a3066ae901, user_id=8a07dc4a3a5b48b19de21752fe420031, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:39.842708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:39.892009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1093/2179] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:39 2022] PUT /identity/v3/projects/1720daa4225d40319db786a3066ae901/users/8a07dc4a3a5b48b19de21752fe420031/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:39.952475 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c658-f0ce-498c-9e7a-646edd15d60c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:39.952963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c658-f0ce-498c-9e7a-646edd15d60c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:39.953440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41c658-f0ce-498c-9e7a-646edd15d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:40.024876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6d41c658-f0ce-498c-9e7a-646edd15d60c None None] MFA Rules not processed for user `8a07dc4a3a5b48b19de21752fe420031`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:40.026406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6d41c658-f0ce-498c-9e7a-646edd15d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:40.201090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1087/2180] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:40.210805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:40.213258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:40.245559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:40.324126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4debe1-acc1-4193-952e-f5d6fe955cd9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:40.329153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a5b9c-1347-41a9-b997-f728866c1512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:40.330026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5b9c-1347-41a9-b997-f728866c1512 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:40.330354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5b9c-1347-41a9-b997-f728866c1512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:40.330636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5b9c-1347-41a9-b997-f728866c1512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:40.441252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a5b9c-1347-41a9-b997-f728866c1512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:40.444001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a5b9c-1347-41a9-b997-f728866c1512 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:40.458597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1094/2181] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:44.375787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c658-f0ce-498c-9e7a-646edd15d60c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:44.454230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41c658-f0ce-498c-9e7a-646edd15d60c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:44.458878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:44.459616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:44.459896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:44.460171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] PATH_INFO: `/v3/users/6447d80f15f042d1a2b472806a214a5a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:44.461330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6447d80f15f042d1a2b472806a214a5a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:44.465622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:44.480862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:44.519313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6447d80f15f042d1a2b472806a214a5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:44.527879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6447d80f15f042d1a2b472806a214a5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:44.528740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6447d80f15f042d1a2b472806a214a5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:44.529440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6447d80f15f042d1a2b472806a214a5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:44.541385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6447d80f15f042d1a2b472806a214a5a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:44.565711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1088/2182] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:44 2022] DELETE /identity/v3/users/6447d80f15f042d1a2b472806a214a5a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:44.570207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:44.570756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:44.571095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:44.597030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:44.599245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:44.684988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1095/2183] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:44.694410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:44.696206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:44.807106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c65922-f18b-46ac-9e23-f4acc073df6b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:44.815165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:44.816044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:44.816615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:44.816997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:44.846082 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:44.847706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:44.899599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1089/2184] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:45.694985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:45.697436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:45.719356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b29de9-9b60-4146-9ba9-9712494283bd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:45.742850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:45.746951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:45.747349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:45.747732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] PATH_INFO: `/v3/projects/c8416938e0a146e4bcb5b21331ae494f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:45.749744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8416938e0a146e4bcb5b21331ae494f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:45.752258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:45.850913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8416938e0a146e4bcb5b21331ae494f', 'request_id': 'req-02f3c963-9e99-4200-8e1d-3a3c16c63c01'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:45.880157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8416938e0a146e4bcb5b21331ae494f', 'request_id': 'req-02f3c963-9e99-4200-8e1d-3a3c16c63c01'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:45.926551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8416938e0a146e4bcb5b21331ae494f', 'request_id': 'req-02f3c963-9e99-4200-8e1d-3a3c16c63c01'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:45.938102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:45.977625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] The token cache is being invalidate because project c8416938e0a146e4bcb5b21331ae494f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:45.979461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:45.982047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:45.988162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1096/2185] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:45 2022] DELETE /identity/v3/projects/c8416938e0a146e4bcb5b21331ae494f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:45.990951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:46.007885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05038bc3-fea8-4f9e-9dd8-7c34c9de1d27 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:46.109286 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:46.110107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:46.110509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:46.110878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] PATH_INFO: `/v3/users/8a07dc4a3a5b48b19de21752fe420031` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:46.112108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a07dc4a3a5b48b19de21752fe420031)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:46.114293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:46.198398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:46.217833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a07dc4a3a5b48b19de21752fe420031'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:46.228570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a07dc4a3a5b48b19de21752fe420031'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:46.229595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a07dc4a3a5b48b19de21752fe420031'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:46.230224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a07dc4a3a5b48b19de21752fe420031'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:46.241713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ccd785c-548b-469d-94d7-0c6710bbe88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a07dc4a3a5b48b19de21752fe420031'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:46.268004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1090/2186] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:45 2022] DELETE /identity/v3/users/8a07dc4a3a5b48b19de21752fe420031 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:47.075096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:47.079184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:47.111610 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3c963-9e99-4200-8e1d-3a3c16c63c01 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:47.223770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:47.224953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:47.225449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:47.225747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] PATH_INFO: `/v3/projects/1720daa4225d40319db786a3066ae901` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:47.227319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1720daa4225d40319db786a3066ae901)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:47.229457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:47.304652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1720daa4225d40319db786a3066ae901', 'request_id': 'req-f44d80f5-269a-42db-995d-f349972f54b0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:47.311949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1720daa4225d40319db786a3066ae901', 'request_id': 'req-f44d80f5-269a-42db-995d-f349972f54b0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:47.331257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1720daa4225d40319db786a3066ae901', 'request_id': 'req-f44d80f5-269a-42db-995d-f349972f54b0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:47.347558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] The token cache is being invalidate because project 1720daa4225d40319db786a3066ae901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:47.348350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:47.349805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:47.351723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1097/2187] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:47 2022] DELETE /identity/v3/projects/1720daa4225d40319db786a3066ae901 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:51.659547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:51.660069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:51.660165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:51.681260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:51.682535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:51.755339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1091/2188] 10.222.0.121 () {58 vars in 972 bytes} [Mon Aug 1 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:51.785405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:51.787755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:51.873662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d80f5-269a-42db-995d-f349972f54b0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:51.879342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88c735-7193-472f-9e73-f040bc38131d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:51.880003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88c735-7193-472f-9e73-f040bc38131d service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:51.880295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88c735-7193-472f-9e73-f040bc38131d service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:51.880680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88c735-7193-472f-9e73-f040bc38131d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:51.891654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88c735-7193-472f-9e73-f040bc38131d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:51.893359 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88c735-7193-472f-9e73-f040bc38131d service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:51.903825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1098/2189] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 17:05:53.101989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:53.103520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:53.197827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3087ec3-1f99-47ce-967b-fb160ad355d4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:53.207081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:53.207933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:53.208324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:53.209649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] PATH_INFO: `/v3/users/1c45ed2c4d1d493faee3a478facf11e1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:53.210949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c45ed2c4d1d493faee3a478facf11e1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:53.213283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:53.286959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c45ed2c4d1d493faee3a478facf11e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:53.295103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c45ed2c4d1d493faee3a478facf11e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:53.295843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c45ed2c4d1d493faee3a478facf11e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:53.296456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c45ed2c4d1d493faee3a478facf11e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:53.299192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:53.305926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c45ed2c4d1d493faee3a478facf11e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:53.333655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1092/2190] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:53 2022] DELETE /identity/v3/users/1c45ed2c4d1d493faee3a478facf11e1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:53.339322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:53.339868 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:53.339960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:53.361742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:53.363006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:53.369518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:53.431821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1099/2191] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:53.441759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:53.443859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:53.518578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757cc81e-7b55-4f8c-83e2-d20f38a79db7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:53.523514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:53.524427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:53.524707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:53.524980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:53.535345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:53.537315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:53.548788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1093/2192] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:53.947831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:53.950438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:53.968831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a1bbc-d77d-4446-89b0-1c74adf29907 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:53.975607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:53.976747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:53.977129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:53.977504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] PATH_INFO: `/v3/projects/09604afd863b444282f7e462d3ded316` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:53.988604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09604afd863b444282f7e462d3ded316)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:53.991327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.045098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09604afd863b444282f7e462d3ded316', 'request_id': 'req-1fc0b690-8ebc-419f-a99e-3458130f66c0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.053566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09604afd863b444282f7e462d3ded316', 'request_id': 'req-1fc0b690-8ebc-419f-a99e-3458130f66c0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.063284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09604afd863b444282f7e462d3ded316', 'request_id': 'req-1fc0b690-8ebc-419f-a99e-3458130f66c0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.074653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.076103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.079283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] The token cache is being invalidate because project 09604afd863b444282f7e462d3ded316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:54.079694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.080451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1fc0b690-8ebc-419f-a99e-3458130f66c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.082195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1100/2193] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:53 2022] DELETE /identity/v3/projects/09604afd863b444282f7e462d3ded316 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:54.087398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf187ac-ddf4-4488-a275-ad3f08a9c0da None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.087691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf187ac-ddf4-4488-a275-ad3f08a9c0da None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.087964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf187ac-ddf4-4488-a275-ad3f08a9c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.090368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94392090-56aa-4f1e-bb5d-050fb671a41b service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.108901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3bf187ac-ddf4-4488-a275-ad3f08a9c0da None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:54.110128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3bf187ac-ddf4-4488-a275-ad3f08a9c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.150782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.151441 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.151723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.152004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] PATH_INFO: `/v3/users/3c9ed488ac684c3da17e4790476f979e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.153184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9ed488ac684c3da17e4790476f979e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.155223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.172117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1101/2194] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:05:54.180937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1615d4-1acf-4053-8627-5a692ca9f772 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.181288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1615d4-1acf-4053-8627-5a692ca9f772 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.181618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1615d4-1acf-4053-8627-5a692ca9f772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.201724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1b1615d4-1acf-4053-8627-5a692ca9f772 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:54.202965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1b1615d4-1acf-4053-8627-5a692ca9f772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.204552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9ed488ac684c3da17e4790476f979e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.211762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9ed488ac684c3da17e4790476f979e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.215623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1102/2195] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:05:54.215774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9ed488ac684c3da17e4790476f979e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.215774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9ed488ac684c3da17e4790476f979e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.219335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1615d4-1acf-4053-8627-5a692ca9f772 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.222234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9ed488ac684c3da17e4790476f979e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.229873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1615d4-1acf-4053-8627-5a692ca9f772 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.236815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.237474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.237763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.238035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.238782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:05:54.239125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.241300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.241431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:54.247137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1094/2196] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:54 2022] DELETE /identity/v3/users/3c9ed488ac684c3da17e4790476f979e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:54.257779 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1103/2197] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:05:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:05:54.259653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.261986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.346541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948539c-26b5-4ca6-8765-0278ffcc0a8c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.357078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.357699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.357986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.358335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.359258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.361455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.391937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1095/2198] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/projects => generated 374 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:54.395956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.410512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41064b99-2d21-4cff-a3da-b5ff41a57d99 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.425777 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:54.480384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.481216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.481529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.481811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.482534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.484503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.510793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1104/2199] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:54.515258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.527511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44110339-c5a6-4134-8c0c-ebbc2e717f62 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.533779 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.534872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.535576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.535683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.535940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.536266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.538019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.539362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.548750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7199a61-a312-48b2-9326-12d8f8260888 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.553727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.554484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.554837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.555185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] PATH_INFO: `/v3/projects/70603abcabac4d4f81d2e38ad26f05b6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.555685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1096/2200] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:54 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:54.559416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.559652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70603abcabac4d4f81d2e38ad26f05b6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.562040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.573276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484185a-33dd-412d-a0aa-5c7eaae691b8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.578759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.579380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.579661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.579940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.580654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.582291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.594544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1097/2201] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:54 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:05:54.598898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.612068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5135-a79d-48d2-9ae7-f4885b6ba59d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.615842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70603abcabac4d4f81d2e38ad26f05b6', 'request_id': 'req-51df1e59-c454-4e28-9344-a94670709ea5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.623966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70603abcabac4d4f81d2e38ad26f05b6', 'request_id': 'req-51df1e59-c454-4e28-9344-a94670709ea5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.634138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70603abcabac4d4f81d2e38ad26f05b6', 'request_id': 'req-51df1e59-c454-4e28-9344-a94670709ea5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.645714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] The token cache is being invalidate because project 70603abcabac4d4f81d2e38ad26f05b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:54.646133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.647454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-51df1e59-c454-4e28-9344-a94670709ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:54.649311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1105/2202] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:54 2022] DELETE /identity/v3/projects/70603abcabac4d4f81d2e38ad26f05b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:54.654183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2521-89ee-4ee8-bd46-4feb58facae1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.654503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2521-89ee-4ee8-bd46-4feb58facae1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.654787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2521-89ee-4ee8-bd46-4feb58facae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.677988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2d7f2521-89ee-4ee8-bd46-4feb58facae1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:54.679561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2d7f2521-89ee-4ee8-bd46-4feb58facae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.679981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7df2f9-319d-454c-b9a1-42ff117c3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.680669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df2f9-319d-454c-b9a1-42ff117c3769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.680964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df2f9-319d-454c-b9a1-42ff117c3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.681244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df2f9-319d-454c-b9a1-42ff117c3769 admin admin] PATH_INFO: `/v3/projects/bde75e7755bd45dcb56649d8ac1f7976/users/4a4cadb6eb5a4ce38e5542559d0b6e06/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.688918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1106/2203] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:05:54.697738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286767-544d-4dcf-9a49-a6fb047062a0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.698030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286767-544d-4dcf-9a49-a6fb047062a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.698342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286767-544d-4dcf-9a49-a6fb047062a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.699912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7df2f9-319d-454c-b9a1-42ff117c3769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde75e7755bd45dcb56649d8ac1f7976, user_id=4a4cadb6eb5a4ce38e5542559d0b6e06, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.702840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7df2f9-319d-454c-b9a1-42ff117c3769 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.719142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1098/2204] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:54 2022] PUT /identity/v3/projects/bde75e7755bd45dcb56649d8ac1f7976/users/4a4cadb6eb5a4ce38e5542559d0b6e06/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:54.719327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b4286767-544d-4dcf-9a49-a6fb047062a0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:54.720306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b4286767-544d-4dcf-9a49-a6fb047062a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.730212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.730521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.730798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.763712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] MFA Rules not processed for user `4a4cadb6eb5a4ce38e5542559d0b6e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:54.765077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.793494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1107/2205] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:54.797449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4286767-544d-4dcf-9a49-a6fb047062a0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.809361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:54.809814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4286767-544d-4dcf-9a49-a6fb047062a0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.815377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.816009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.816291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.816568 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.817273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:05:54.817734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.820502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.834999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1108/2206] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:05:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:05:54.840391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.853285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1099/2207] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:54.855825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba999df7-ebb0-4e7d-af4d-432f4cd104c7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.860687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.861306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.861593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.861870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.862574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:54.864168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.865992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:54.867778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:54.872166 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:54.917067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1109/2208] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/projects => generated 364 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:54.921637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:54.938014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a4bc-5f50-469d-9b44-c406d7b68b45 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.992348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c750c-3c5a-4dd0-8a12-dde10251f1d9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:54.997409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:54.998038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:54.998339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:54.998619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:54.999292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.001215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.003825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.004581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.004954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.005297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.024317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1110/2209] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:54 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:55.028585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:55.038623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0e7c3-5664-4e7a-a285-6fc0d5e6fc54 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:55.043413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.044024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.044307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.044582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.045279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.046953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.057846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1111/2210] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:55 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:55.061624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:55.065216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.066912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.072121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63386c78-3c02-49c5-adac-39aa1e77cf28 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:55.076837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.077441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.077956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1100/2211] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:05:55.078401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.078805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.079645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.081341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.092945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1112/2212] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:55 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:05:55.099654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:55.101537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:55.103212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:55.110961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabbdfb-58a7-47cd-bd3c-83a7c057a24e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:55.116054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3018d7-c0df-4536-a77d-0a913cf60267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.116257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b281-91d4-4b0b-9a0f-62faf444fad1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:55.116741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3018d7-c0df-4536-a77d-0a913cf60267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.117131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3018d7-c0df-4536-a77d-0a913cf60267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.117410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3018d7-c0df-4536-a77d-0a913cf60267 admin admin] PATH_INFO: `/v3/projects/d50c0beeb7ea4e3b9667c5b21a30e704/users/de7a02881aba43419914a4516688c4fa/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.120971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.121601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.121880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.122150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] PATH_INFO: `/v3/users/4a4cadb6eb5a4ce38e5542559d0b6e06` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.123347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4cadb6eb5a4ce38e5542559d0b6e06)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.125608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.132825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3018d7-c0df-4536-a77d-0a913cf60267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50c0beeb7ea4e3b9667c5b21a30e704, user_id=de7a02881aba43419914a4516688c4fa, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.135574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3018d7-c0df-4536-a77d-0a913cf60267 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.150747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1101/2213] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:55 2022] PUT /identity/v3/projects/d50c0beeb7ea4e3b9667c5b21a30e704/users/de7a02881aba43419914a4516688c4fa/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:55.162015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.163249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.163695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.184846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4cadb6eb5a4ce38e5542559d0b6e06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:55.192192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4cadb6eb5a4ce38e5542559d0b6e06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:55.194798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] MFA Rules not processed for user `de7a02881aba43419914a4516688c4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:55.195760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:55.203848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:55.205544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4cadb6eb5a4ce38e5542559d0b6e06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:55.206441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4cadb6eb5a4ce38e5542559d0b6e06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:55.207281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-80199636-a31a-40c8-b4b3-7d807bcd5879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4cadb6eb5a4ce38e5542559d0b6e06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:55.222691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1113/2214] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:05:55 2022] DELETE /identity/v3/users/4a4cadb6eb5a4ce38e5542559d0b6e06 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:55.227160 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.227451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.227736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.247113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:55.248332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:55.265626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1102/2215] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:55.269496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:55.278612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:55.280138 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:55.313208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1114/2216] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:55.323334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:55.324783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:55.338050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad2f82-22b4-448a-938d-261bd2a71e7a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:55.386246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da174550-4ecb-4070-a3a3-fb7d45b40bb8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:55.390079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.390838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.391014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.391429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.401233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277568d-a9dd-42eb-8063-d78ffae428d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.401428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.401837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277568d-a9dd-42eb-8063-d78ffae428d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.402120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277568d-a9dd-42eb-8063-d78ffae428d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.402504 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277568d-a9dd-42eb-8063-d78ffae428d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.403076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.414126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1115/2217] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:05:55.465720 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277568d-a9dd-42eb-8063-d78ffae428d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.467267 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277568d-a9dd-42eb-8063-d78ffae428d6 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.479026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1103/2218] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:55.847065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:55.848693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:55.862935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1628f6-b37e-49bb-aadf-466a9a9e77dc service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:55.871455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:55.872646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:55.873111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:55.873560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] PATH_INFO: `/v3/projects/bde75e7755bd45dcb56649d8ac1f7976` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:55.876004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde75e7755bd45dcb56649d8ac1f7976)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:55.880670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:55.971747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde75e7755bd45dcb56649d8ac1f7976', 'request_id': 'req-e908d89f-e4e7-44fe-a1a1-e0b663de334a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:55.980423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde75e7755bd45dcb56649d8ac1f7976', 'request_id': 'req-e908d89f-e4e7-44fe-a1a1-e0b663de334a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:55.988078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde75e7755bd45dcb56649d8ac1f7976', 'request_id': 'req-e908d89f-e4e7-44fe-a1a1-e0b663de334a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:56.011929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] The token cache is being invalidate because project bde75e7755bd45dcb56649d8ac1f7976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:05:56.012381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:56.013613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e908d89f-e4e7-44fe-a1a1-e0b663de334a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:05:56.015416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1116/2219] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:05:55 2022] DELETE /identity/v3/projects/bde75e7755bd45dcb56649d8ac1f7976 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:05:56.020660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c3c1-f146-4cc7-8b0e-e0bd1707a54b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.020660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c3c1-f146-4cc7-8b0e-e0bd1707a54b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.021092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c3c1-f146-4cc7-8b0e-e0bd1707a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.043840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8726c3c1-f146-4cc7-8b0e-e0bd1707a54b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:56.045943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8726c3c1-f146-4cc7-8b0e-e0bd1707a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:56.063726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:56.129848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1104/2220] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:56.137740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f17a-55d8-4cea-90a4-dee66bff1263 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.138034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f17a-55d8-4cea-90a4-dee66bff1263 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.138366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f17a-55d8-4cea-90a4-dee66bff1263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.159371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3fb7f17a-55d8-4cea-90a4-dee66bff1263 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:56.160600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3fb7f17a-55d8-4cea-90a4-dee66bff1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:56.169525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1117/2221] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:56.173806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726c3c1-f146-4cc7-8b0e-e0bd1707a54b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:56.184409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726c3c1-f146-4cc7-8b0e-e0bd1707a54b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:56.189794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:56.190453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.190735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.191011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.191728 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:05:56.192009 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:56.193580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:56.210828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1105/2222] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:05:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:05:56.211941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7f17a-55d8-4cea-90a4-dee66bff1263 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:56.221207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7f17a-55d8-4cea-90a4-dee66bff1263 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:56.226458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:56.227065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.227346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.227622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.228298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:56.230204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:56.258214 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1118/2223] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:05:56 2022] POST /identity/v3/projects => generated 376 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:05:56.262726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:56.272627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91242-de7e-41d4-819f-3356e256584b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:56.327576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:56.328199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.328486 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.328766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.329446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:56.331415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:56.353449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1106/2224] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:05:56 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:05:56.357649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:56.373347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031daad5-0522-465b-a4b2-c4e81a5631d2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:56.378646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:56.379271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.379555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.379836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.380536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:56.382143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:56.393852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1119/2225] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:56 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:56.398173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:56.408378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab658f9-16c4-4e1e-b3cf-23415d906050 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:56.413817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf668df-e695-41c1-a923-de8bf3b8b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:56.414600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf668df-e695-41c1-a923-de8bf3b8b106 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.414883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf668df-e695-41c1-a923-de8bf3b8b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.415157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf668df-e695-41c1-a923-de8bf3b8b106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.415843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf668df-e695-41c1-a923-de8bf3b8b106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:56.417423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf668df-e695-41c1-a923-de8bf3b8b106 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:56.428814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1107/2226] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:05:56 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:05:56.433373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:56.443791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad3299-2e4a-4a88-bd10-97584aed95f8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:56.448450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:56.449103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.449394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.449674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] PATH_INFO: `/v3/projects/88f2bb363c9842388501afdfe5d085b5/users/0c010002620b40b0a3c38eae47702222/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.460599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:05:56.465223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f2bb363c9842388501afdfe5d085b5, user_id=0c010002620b40b0a3c38eae47702222, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:56.468248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:56.483207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1120/2227] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:05:56 2022] PUT /identity/v3/projects/88f2bb363c9842388501afdfe5d085b5/users/0c010002620b40b0a3c38eae47702222/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:05:56.494471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356416b-d6d7-482d-a7be-deaed8f22d70 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.494820 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356416b-d6d7-482d-a7be-deaed8f22d70 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.495092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356416b-d6d7-482d-a7be-deaed8f22d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.523565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1356416b-d6d7-482d-a7be-deaed8f22d70 None None] MFA Rules not processed for user `0c010002620b40b0a3c38eae47702222`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:56.524969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1356416b-d6d7-482d-a7be-deaed8f22d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:56.589168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1108/2228] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:05:56.602292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:05:56.604054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:56.660384 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652b557-50d4-4dc3-8337-ade1201e1ef0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:05:56.664726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cc3ab-f8fd-4fe2-88e4-2edc2f7bb6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:05:56.665352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc3ab-f8fd-4fe2-88e4-2edc2f7bb6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:56.665662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc3ab-f8fd-4fe2-88e4-2edc2f7bb6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:56.665940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc3ab-f8fd-4fe2-88e4-2edc2f7bb6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:56.676039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cc3ab-f8fd-4fe2-88e4-2edc2f7bb6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:05:56.677502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cc3ab-f8fd-4fe2-88e4-2edc2f7bb6e6 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:05:56.695558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1121/2229] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:05:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:05:58.121481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a427f-56d0-4ddd-8cf7-7197be7319b1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:05:58.122185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a427f-56d0-4ddd-8cf7-7197be7319b1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:05:58.122525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a427f-56d0-4ddd-8cf7-7197be7319b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:05:58.143693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ed3a427f-56d0-4ddd-8cf7-7197be7319b1 None None] MFA Rules not processed for user `0c010002620b40b0a3c38eae47702222`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:05:58.145017 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ed3a427f-56d0-4ddd-8cf7-7197be7319b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:05:58.153707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1109/2230] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:05:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:03.819159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe131-b631-4089-9491-f41011d889ec None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.819643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe131-b631-4089-9491-f41011d889ec None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.819827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe131-b631-4089-9491-f41011d889ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:03.840459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-152fe131-b631-4089-9491-f41011d889ec None None] MFA Rules not processed for user `5c607e35877c4872a448c9a5e8a8a29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:03.841925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-152fe131-b631-4089-9491-f41011d889ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:03.935804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1122/2231] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:03.978192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2147b-0a28-43ca-a07b-9ced047e9a2e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:03.979021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2147b-0a28-43ca-a07b-9ced047e9a2e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:03.979452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2147b-0a28-43ca-a07b-9ced047e9a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:04.008825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5ee2147b-0a28-43ca-a07b-9ced047e9a2e None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:04.010069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ee2147b-0a28-43ca-a07b-9ced047e9a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:04.015636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:04.084738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1110/2232] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:04.099585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fe131-b631-4089-9491-f41011d889ec None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:04.103155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-152fe131-b631-4089-9491-f41011d889ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:04.198596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fe131-b631-4089-9491-f41011d889ec None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:04.202776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:04.202776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:04.202776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:04.203340 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:04.213024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:04.215032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:04.224804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1123/2233] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:14.073879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=21 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:14.221098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:18.163123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f022c4a-b1c3-43c5-897b-1d7597046204 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:18.163758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f022c4a-b1c3-43c5-897b-1d7597046204 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:18.163758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f022c4a-b1c3-43c5-897b-1d7597046204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:18.184884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3f022c4a-b1c3-43c5-897b-1d7597046204 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:18.186094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3f022c4a-b1c3-43c5-897b-1d7597046204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:18.195443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1111/2234] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:06:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:18.208876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:18.219959 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be427-b9ed-4169-b215-e801d707824a service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:18.225555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:18.226215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:18.226558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:18.226838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:18.235789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:18.237088 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:18.250559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1124/2235] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:06:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:18.768001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e03a6-61fb-4ec6-aec7-83f7f03c6f2d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:18.768362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e03a6-61fb-4ec6-aec7-83f7f03c6f2d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:18.768703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e03a6-61fb-4ec6-aec7-83f7f03c6f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:18.793899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0b6e03a6-61fb-4ec6-aec7-83f7f03c6f2d None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:18.795706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b6e03a6-61fb-4ec6-aec7-83f7f03c6f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:18.811959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1112/2236] 10.222.0.121 () {58 vars in 972 bytes} [Mon Aug 1 17:06:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:18.824442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:18.835539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3b84-ac5c-4b73-8a68-e24e428264a8 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:18.841269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:18.841899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:18.842187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:18.842494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:18.857111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:18.859711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:18.870514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1125/2237] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:06:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:19.110769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceeb0af-e9ff-48fa-aaa8-fff4f36b08e9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:19.111056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceeb0af-e9ff-48fa-aaa8-fff4f36b08e9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:19.111362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceeb0af-e9ff-48fa-aaa8-fff4f36b08e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:19.130536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eceeb0af-e9ff-48fa-aaa8-fff4f36b08e9 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:19.131732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eceeb0af-e9ff-48fa-aaa8-fff4f36b08e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:19.138906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1113/2238] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:06:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:19.152173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:19.163529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9386-242d-44dc-8a5b-207c0064d237 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:19.168833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:19.169457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:19.169740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:19.170014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:19.179812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:19.181475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:19.191001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1126/2239] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:19.509306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20227b2a-b4c5-49da-b72f-c29b92a99506 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:19.509776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20227b2a-b4c5-49da-b72f-c29b92a99506 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:19.509875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20227b2a-b4c5-49da-b72f-c29b92a99506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:19.531668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-20227b2a-b4c5-49da-b72f-c29b92a99506 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:19.532851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20227b2a-b4c5-49da-b72f-c29b92a99506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:19.540244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1114/2240] 10.222.0.121 () {58 vars in 972 bytes} [Mon Aug 1 17:06:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:19.552495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:19.563138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53099ea-4eab-4eaf-86eb-3af342e8d7a4 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:19.568747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6b1a3-7285-4e68-b31e-8baa26f6bc56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:19.569376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b1a3-7285-4e68-b31e-8baa26f6bc56 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:19.569660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b1a3-7285-4e68-b31e-8baa26f6bc56 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:19.569934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6b1a3-7285-4e68-b31e-8baa26f6bc56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:19.578093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6b1a3-7285-4e68-b31e-8baa26f6bc56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:19.579719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6b1a3-7285-4e68-b31e-8baa26f6bc56 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:19.588605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1127/2241] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 17:06:21.752678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20227b2a-b4c5-49da-b72f-c29b92a99506 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:21.835038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20227b2a-b4c5-49da-b72f-c29b92a99506 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:21.839896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:21.840566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:21.840840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:21.841118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] PATH_INFO: `/v3/users/0c010002620b40b0a3c38eae47702222` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:21.842326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c010002620b40b0a3c38eae47702222)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:21.844251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:21.899178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c010002620b40b0a3c38eae47702222'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.906406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c010002620b40b0a3c38eae47702222'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.907759 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c010002620b40b0a3c38eae47702222'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.908491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c010002620b40b0a3c38eae47702222'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.917501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c010002620b40b0a3c38eae47702222'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:21.939268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1115/2242] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:06:21 2022] DELETE /identity/v3/users/0c010002620b40b0a3c38eae47702222 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:21.943759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:21.944228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:21.944329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:21.964835 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:21.966061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:22.050960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1128/2243] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:22.058181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:22.060054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:22.120413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611f0e9-45ff-4aa1-90a1-e907254ed036 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:22.124135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56677551-5e18-4c4c-8b16-af32e4ccca4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:22.124767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677551-5e18-4c4c-8b16-af32e4ccca4d service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:22.125053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677551-5e18-4c4c-8b16-af32e4ccca4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:22.125332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56677551-5e18-4c4c-8b16-af32e4ccca4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:22.133072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:22.135478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56677551-5e18-4c4c-8b16-af32e4ccca4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:22.137222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56677551-5e18-4c4c-8b16-af32e4ccca4d service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:22.149816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1116/2244] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:22.440257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:22.443716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:22.469744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b5eba-1999-464d-81ab-3ea091fe1ae9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:22.477386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:22.478000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:22.478412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:22.478694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] PATH_INFO: `/v3/projects/88f2bb363c9842388501afdfe5d085b5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:22.480226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f2bb363c9842388501afdfe5d085b5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:22.482198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:22.534929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f2bb363c9842388501afdfe5d085b5', 'request_id': 'req-e5568569-e516-4a00-a225-ecb0884fff7e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:22.542127 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f2bb363c9842388501afdfe5d085b5', 'request_id': 'req-e5568569-e516-4a00-a225-ecb0884fff7e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:22.552510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f2bb363c9842388501afdfe5d085b5', 'request_id': 'req-e5568569-e516-4a00-a225-ecb0884fff7e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:22.568078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] The token cache is being invalidate because project 88f2bb363c9842388501afdfe5d085b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:06:22.568372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:22.569112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e5568569-e516-4a00-a225-ecb0884fff7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:22.570744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1129/2245] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:06:22 2022] DELETE /identity/v3/projects/88f2bb363c9842388501afdfe5d085b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:22.575829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93613-1913-4084-9399-cbdb95bb7e68 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:22.576290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93613-1913-4084-9399-cbdb95bb7e68 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:22.576649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93613-1913-4084-9399-cbdb95bb7e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:22.601502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4df93613-1913-4084-9399-cbdb95bb7e68 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:22.602989 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4df93613-1913-4084-9399-cbdb95bb7e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:22.679077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1117/2246] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:22.682207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecce92-8842-443b-aee5-5bd48be29be7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:22.682540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecce92-8842-443b-aee5-5bd48be29be7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:22.682828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecce92-8842-443b-aee5-5bd48be29be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:22.704867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-54ecce92-8842-443b-aee5-5bd48be29be7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:22.706251 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-54ecce92-8842-443b-aee5-5bd48be29be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:22.718416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1130/2247] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:22.721434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df93613-1913-4084-9399-cbdb95bb7e68 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:22.733929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df93613-1913-4084-9399-cbdb95bb7e68 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:22.740884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:22.741827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:22.742327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:22.742811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:22.744067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:06:22.744496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:22.746481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:22.772125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1118/2248] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:06:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:06:22.777180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecce92-8842-443b-aee5-5bd48be29be7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:22.787765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecce92-8842-443b-aee5-5bd48be29be7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:22.793570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:22.794572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:22.795050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:22.795516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:22.796394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:22.798752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:22.859412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1131/2249] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:06:22 2022] POST /identity/v3/projects => generated 384 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:06:22.860337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:22.872957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25747f9d-ff93-4cd5-bd22-4206b5e5d2a2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:22.958152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:22.959045 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:22.960624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:22.960624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:22.961160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:22.964046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:22.988093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1119/2250] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:06:22 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:06:22.992793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:22.998467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:23.005573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb457abc-d311-4733-accc-b6397dc54952 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:23.012428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:23.013426 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.013971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.014362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.015153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:23.016852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:23.028138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1132/2251] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:06:22 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:06:23.032436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:23.044451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8eaa92-996e-4856-8115-097b71285c5f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:23.050423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f848a77-fe2a-4003-85ce-1a1c77f4a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:23.051129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f848a77-fe2a-4003-85ce-1a1c77f4a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.052473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f848a77-fe2a-4003-85ce-1a1c77f4a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.052606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f848a77-fe2a-4003-85ce-1a1c77f4a9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.053347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f848a77-fe2a-4003-85ce-1a1c77f4a9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:23.055115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f848a77-fe2a-4003-85ce-1a1c77f4a9f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:23.075551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:23.082054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1120/2252] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:06:23 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:06:23.087126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c88e0d-2370-4d9f-bb47-4783ac493ce5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:23.092511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:23.093192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.093481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.093781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] PATH_INFO: `/v3/projects/843abee32d7542baaf3b446d8eb738d2/users/c9dc388b0b624f5b9b8ebe2096c5c2f2/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.115866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843abee32d7542baaf3b446d8eb738d2, user_id=c9dc388b0b624f5b9b8ebe2096c5c2f2, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:23.118607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:23.137795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1133/2253] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:06:23 2022] PUT /identity/v3/projects/843abee32d7542baaf3b446d8eb738d2/users/c9dc388b0b624f5b9b8ebe2096c5c2f2/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:23.139351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c83e8-eda0-41ab-ae18-aca7791b3b9d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.139674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c83e8-eda0-41ab-ae18-aca7791b3b9d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.140033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c83e8-eda0-41ab-ae18-aca7791b3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.172275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-327c83e8-eda0-41ab-ae18-aca7791b3b9d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:23.173641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-327c83e8-eda0-41ab-ae18-aca7791b3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:23.243961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1121/2254] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:06:23.253772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:23.255755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:23.323775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdf201-11bd-4cf1-8954-cf115518d409 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:23.328975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddd1c2-bffe-4d07-9e99-1d836fb1179e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:23.329897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddd1c2-bffe-4d07-9e99-1d836fb1179e service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.330250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddd1c2-bffe-4d07-9e99-1d836fb1179e service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.330631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddd1c2-bffe-4d07-9e99-1d836fb1179e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.341343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddd1c2-bffe-4d07-9e99-1d836fb1179e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:23.342953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddd1c2-bffe-4d07-9e99-1d836fb1179e service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:23.355805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1134/2255] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:23.428110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e5b1-78d2-45cf-b20c-e8f7b0f36af9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.428646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e5b1-78d2-45cf-b20c-e8f7b0f36af9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.429131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23e5b1-78d2-45cf-b20c-e8f7b0f36af9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.431061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1122/2256] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:06:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:06:23.438613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c099bd4-0fb0-4600-aac3-f91d01e860ac None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.439069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c099bd4-0fb0-4600-aac3-f91d01e860ac None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.439421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c099bd4-0fb0-4600-aac3-f91d01e860ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.461480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1c099bd4-0fb0-4600-aac3-f91d01e860ac None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:23.462932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1c099bd4-0fb0-4600-aac3-f91d01e860ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:23.561914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1135/2257] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:23.580183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23e5b1-78d2-45cf-b20c-e8f7b0f36af9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:23.582692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7c23e5b1-78d2-45cf-b20c-e8f7b0f36af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:23.591121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:23.684002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23e5b1-78d2-45cf-b20c-e8f7b0f36af9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:23.688975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbeb85-0fe1-4586-9b5e-82e809497cb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:23.689789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbeb85-0fe1-4586-9b5e-82e809497cb1 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.690539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbeb85-0fe1-4586-9b5e-82e809497cb1 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.690899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbeb85-0fe1-4586-9b5e-82e809497cb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.702392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbeb85-0fe1-4586-9b5e-82e809497cb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:23.703963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbeb85-0fe1-4586-9b5e-82e809497cb1 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:23.725159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1123/2258] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:23.806574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95bf0-22cf-42e7-b789-0ed42b799b85 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.807003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95bf0-22cf-42e7-b789-0ed42b799b85 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.807289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95bf0-22cf-42e7-b789-0ed42b799b85 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.808985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1136/2259] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:06:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:06:23.813964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44ef3-6a30-4831-87ce-5b2cda67743e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.814498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44ef3-6a30-4831-87ce-5b2cda67743e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.814634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44ef3-6a30-4831-87ce-5b2cda67743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.844015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-73e44ef3-6a30-4831-87ce-5b2cda67743e None None] MFA Rules not processed for user `112c65065f6d4c5990f3952e0099cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:23.845496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-73e44ef3-6a30-4831-87ce-5b2cda67743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:23.853766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1124/2260] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:23.867018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95bf0-22cf-42e7-b789-0ed42b799b85 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:23.885422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95bf0-22cf-42e7-b789-0ed42b799b85 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:23.899118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b956b4-4463-4726-a6eb-61b24160a34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:23.902376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b956b4-4463-4726-a6eb-61b24160a34f service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:23.902794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b956b4-4463-4726-a6eb-61b24160a34f service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:23.903153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b956b4-4463-4726-a6eb-61b24160a34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:23.913324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b956b4-4463-4726-a6eb-61b24160a34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:23.915060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b956b4-4463-4726-a6eb-61b24160a34f service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:23.926674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1137/2261] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:06:24.028264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4a47-b36e-4a83-9687-4883d538a8b9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:24.028892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4a47-b36e-4a83-9687-4883d538a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:24.029303 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b4a47-b36e-4a83-9687-4883d538a8b9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:24.031067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1125/2262] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:06:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:06:24.037226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e9577-c89b-43dc-9d8a-16525a594dcd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:24.037870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e9577-c89b-43dc-9d8a-16525a594dcd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:24.037870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e9577-c89b-43dc-9d8a-16525a594dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:24.059926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-966e9577-c89b-43dc-9d8a-16525a594dcd None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:24.061099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-966e9577-c89b-43dc-9d8a-16525a594dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:24.071810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1138/2263] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:24.084168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4a47-b36e-4a83-9687-4883d538a8b9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:24.096177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b4a47-b36e-4a83-9687-4883d538a8b9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:24.100054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:24.100690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:24.100998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:24.101242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:24.116268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:24.117981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:24.135165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1126/2264] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:24.515625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137730-eb28-48d3-afe3-7846716e9703 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:24.515917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137730-eb28-48d3-afe3-7846716e9703 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:24.516401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137730-eb28-48d3-afe3-7846716e9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:24.548789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7d137730-eb28-48d3-afe3-7846716e9703 None None] MFA Rules not processed for user `c9dc388b0b624f5b9b8ebe2096c5c2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:24.550300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7d137730-eb28-48d3-afe3-7846716e9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:24.583495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:24.643185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1139/2265] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:24.669435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:24.670967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:24.781687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60743f5-46dc-49bb-b8fd-cce2752e420b service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:24.786990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce834dca-3768-4da6-a267-6f7ac20627a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:24.787707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce834dca-3768-4da6-a267-6f7ac20627a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:24.788064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce834dca-3768-4da6-a267-6f7ac20627a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:24.788342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce834dca-3768-4da6-a267-6f7ac20627a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:24.803247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce834dca-3768-4da6-a267-6f7ac20627a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:24.805039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce834dca-3768-4da6-a267-6f7ac20627a1 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:24.817306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1127/2266] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:06:26.251711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:26.252193 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:26.252287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:26.271489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] MFA Rules not processed for user `c9dc388b0b624f5b9b8ebe2096c5c2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:26.272812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:26.280198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1140/2267] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:28.347482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:28.348081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:28.348081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:28.369147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:28.370395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:28.431775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1128/2268] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:06:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:28.458667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:28.460189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:28.532652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316f4a1-de97-43ac-a5da-e26e54ff280f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:28.537809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7659-c320-4df9-a564-ad13afd53593 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:28.538474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7659-c320-4df9-a564-ad13afd53593 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:28.538748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7659-c320-4df9-a564-ad13afd53593 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:28.539022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7659-c320-4df9-a564-ad13afd53593 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:28.547879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7659-c320-4df9-a564-ad13afd53593 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:28.549550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7659-c320-4df9-a564-ad13afd53593 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:28.558133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1141/2269] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:06:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:31.497075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:31.498650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:31.514991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc472e-2a2c-4818-91c8-20e0b1dc389f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:31.519680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:31.521062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:31.521777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:31.521777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] PATH_INFO: `/v3/users/de7a02881aba43419914a4516688c4fa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:31.523050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7a02881aba43419914a4516688c4fa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:31.525350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:31.558484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:31.579977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7a02881aba43419914a4516688c4fa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:31.590169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7a02881aba43419914a4516688c4fa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:31.591207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7a02881aba43419914a4516688c4fa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:31.591850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7a02881aba43419914a4516688c4fa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:31.600967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7a02881aba43419914a4516688c4fa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:31.623037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1129/2270] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:06:31 2022] DELETE /identity/v3/users/de7a02881aba43419914a4516688c4fa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:31.628862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:31.629947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:31.630125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:31.653148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:31.654821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:31.738335 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1142/2271] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:31.753368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:31.756692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:31.841894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d572f-e347-4b2f-a4f0-efc2fb54b32f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:31.846546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00716854-a94d-4f02-ba76-d5c60dca78b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:31.847188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716854-a94d-4f02-ba76-d5c60dca78b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:31.847477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716854-a94d-4f02-ba76-d5c60dca78b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:31.847757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716854-a94d-4f02-ba76-d5c60dca78b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:31.858302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00716854-a94d-4f02-ba76-d5c60dca78b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:31.859860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00716854-a94d-4f02-ba76-d5c60dca78b2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:31.872128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1130/2272] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:32.286514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:32.288244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:32.314308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a79d3f-98f0-4c3f-8251-09f0c0f70e9d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:32.322725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:32.324061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:32.324338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:32.324615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] PATH_INFO: `/v3/projects/d50c0beeb7ea4e3b9667c5b21a30e704` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:32.326628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50c0beeb7ea4e3b9667c5b21a30e704)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:32.328705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:32.407998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50c0beeb7ea4e3b9667c5b21a30e704', 'request_id': 'req-ded08365-4a3b-49be-b8ee-abc99e5dc184'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:32.412513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:32.455085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50c0beeb7ea4e3b9667c5b21a30e704', 'request_id': 'req-ded08365-4a3b-49be-b8ee-abc99e5dc184'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:32.472293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50c0beeb7ea4e3b9667c5b21a30e704', 'request_id': 'req-ded08365-4a3b-49be-b8ee-abc99e5dc184'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:32.495576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] The token cache is being invalidate because project d50c0beeb7ea4e3b9667c5b21a30e704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:06:32.495965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:32.496628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:06:32.510577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1143/2273] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:06:32 2022] DELETE /identity/v3/projects/d50c0beeb7ea4e3b9667c5b21a30e704 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:06:41.867397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=45,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:42.487257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:06:46.386382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:46.386878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:46.386975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:46.406793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:06:46.408001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:46.465378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1131/2274] 10.222.0.121 () {58 vars in 972 bytes} [Mon Aug 1 17:06:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:06:46.477966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:46.480207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:46.552690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded08365-4a3b-49be-b8ee-abc99e5dc184 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:46.557745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90704-749f-482c-a44b-5c3ef49ce032 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:46.558409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90704-749f-482c-a44b-5c3ef49ce032 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:46.558727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90704-749f-482c-a44b-5c3ef49ce032 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:46.559007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90704-749f-482c-a44b-5c3ef49ce032 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:46.568119 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90704-749f-482c-a44b-5c3ef49ce032 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:46.569709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb90704-749f-482c-a44b-5c3ef49ce032 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:46.578039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1144/2275] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:06:52.360744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:06:52.362181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:52.446831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925a33d-8ea1-4301-94ba-c2973677bc03 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:06:52.451994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555a462-fbce-4a61-954f-fb2f64de4f9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:06:52.452631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555a462-fbce-4a61-954f-fb2f64de4f9e service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:06:52.452916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555a462-fbce-4a61-954f-fb2f64de4f9e service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:06:52.453196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555a462-fbce-4a61-954f-fb2f64de4f9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:06:52.455548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3555a462-fbce-4a61-954f-fb2f64de4f9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:06:52.467753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555a462-fbce-4a61-954f-fb2f64de4f9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:06:52.469344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555a462-fbce-4a61-954f-fb2f64de4f9e service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:06:52.481092 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1132/2276] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:06:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:06:56.574700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=32 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:02.476881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=57 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:03.968165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:03.968684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:03.968788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:03.988173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] MFA Rules not processed for user `b125e48efd9c4907be550b3f4077134c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:03.989375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:04.045637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1145/2277] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:07:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:09.897950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508288-ba2b-49ec-b48d-6432fcd7d5ec None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:09.898769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508288-ba2b-49ec-b48d-6432fcd7d5ec None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:09.899032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508288-ba2b-49ec-b48d-6432fcd7d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:09.920315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a5508288-ba2b-49ec-b48d-6432fcd7d5ec None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:09.921665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a5508288-ba2b-49ec-b48d-6432fcd7d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:09.981134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1133/2278] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:07:10.007202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:10.008657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:10.087475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca818b4d-8cae-42de-8394-2d9f34d2bcad None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:10.093243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:10.093864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:10.094146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:10.094474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:10.103358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:10.104971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:10.114250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1146/2279] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:13.969891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f94d2-67b2-4012-9821-79e307172240 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:13.970444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f94d2-67b2-4012-9821-79e307172240 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:13.970610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f94d2-67b2-4012-9821-79e307172240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:13.990643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c25f94d2-67b2-4012-9821-79e307172240 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:13.991866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c25f94d2-67b2-4012-9821-79e307172240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:14.000309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1134/2280] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:14.028514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:14.029706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:14.046337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600e7f-c810-4a3d-9bb9-f4ce764ec1b8 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:14.052684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:14.053616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:14.053885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:14.054152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:14.064356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:14.066038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:14.076642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1147/2281] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:17.277316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541882bd-6c20-4f93-8c03-9935950554eb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:17.277889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541882bd-6c20-4f93-8c03-9935950554eb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:17.277889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541882bd-6c20-4f93-8c03-9935950554eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:17.296953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-541882bd-6c20-4f93-8c03-9935950554eb None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:17.298165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-541882bd-6c20-4f93-8c03-9935950554eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:17.306105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1135/2282] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:17.329014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:17.341540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbe3a4-cc34-49f1-93dc-ca055b58c122 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:17.348087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:17.348701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:17.348986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:17.349293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:17.358291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:17.359990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:17.370300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1148/2283] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:21.364066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0eb15-4609-4dae-9315-4cb921991410 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:21.364559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0eb15-4609-4dae-9315-4cb921991410 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:21.364559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0eb15-4609-4dae-9315-4cb921991410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:21.383491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6dd0eb15-4609-4dae-9315-4cb921991410 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:21.384685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6dd0eb15-4609-4dae-9315-4cb921991410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:21.392368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1136/2284] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:21.421341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:21.432450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a9e66-1c16-44e3-adb0-4133d41973a9 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:21.437909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:21.438539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:21.438826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:21.439103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:21.447379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:21.448954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:21.458854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1149/2285] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:25.565330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c15cdb-eaee-49c1-8734-46f2df127606 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:25.565911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c15cdb-eaee-49c1-8734-46f2df127606 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:25.566148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c15cdb-eaee-49c1-8734-46f2df127606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:25.588969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-56c15cdb-eaee-49c1-8734-46f2df127606 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:25.590821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-56c15cdb-eaee-49c1-8734-46f2df127606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:25.599892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1137/2286] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:25.622876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:25.634929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0cd0-ffd9-4395-a462-0926eb8603ea service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:25.642846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:25.643566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:25.644061 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:25.644482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:25.659840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:25.662042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:25.676716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1150/2287] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:28.743998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6c13-4a59-4d02-9360-675c020019c2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:28.744564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6c13-4a59-4d02-9360-675c020019c2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:28.744564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b6c13-4a59-4d02-9360-675c020019c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:28.765254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3a9b6c13-4a59-4d02-9360-675c020019c2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:28.766611 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a9b6c13-4a59-4d02-9360-675c020019c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:28.776032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1138/2288] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:28.796993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:07:28.802863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=84 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:28.810429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff0216-5a60-4263-84cc-ee64d52a4754 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:07:28.816158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bb816-4e2d-4826-8358-414643f06e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:07:28.816777 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb816-4e2d-4826-8358-414643f06e56 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:28.817062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb816-4e2d-4826-8358-414643f06e56 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:28.817344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bb816-4e2d-4826-8358-414643f06e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:28.826007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb816-4e2d-4826-8358-414643f06e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:07:28.827632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bb816-4e2d-4826-8358-414643f06e56 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:07:28.837676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1151/2289] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:07:38.759995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=42 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:38.833491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:46.249870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2696-c49c-4948-9022-c015e7417c7d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:46.250523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2696-c49c-4948-9022-c015e7417c7d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:46.250875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2696-c49c-4948-9022-c015e7417c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:46.284879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fbae2696-c49c-4948-9022-c015e7417c7d None None] MFA Rules not processed for user `c9dc388b0b624f5b9b8ebe2096c5c2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:46.287867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fbae2696-c49c-4948-9022-c015e7417c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:46.358323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1139/2290] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:07:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:48.383189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080c4c8-ccb7-4409-aedb-2e2ab2511b0d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:48.384895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080c4c8-ccb7-4409-aedb-2e2ab2511b0d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:48.385640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080c4c8-ccb7-4409-aedb-2e2ab2511b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:48.423896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c080c4c8-ccb7-4409-aedb-2e2ab2511b0d None None] MFA Rules not processed for user `5c607e35877c4872a448c9a5e8a8a29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:48.426768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c080c4c8-ccb7-4409-aedb-2e2ab2511b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:48.504484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1152/2291] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:07:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:48.859046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec228ed-bb26-436d-8549-b72602ea4b3b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:07:48.859944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec228ed-bb26-436d-8549-b72602ea4b3b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:07:48.860386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec228ed-bb26-436d-8549-b72602ea4b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:07:48.888149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5ec228ed-bb26-436d-8549-b72602ea4b3b None None] MFA Rules not processed for user `cc1712f30dcc4ff4b350c91c76f5a3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:07:48.889568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ec228ed-bb26-436d-8549-b72602ea4b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:07:48.989808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1140/2292] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:07:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:07:58.492402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=25 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:07:58.987509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=50 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:08.451411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b8849-7f98-41f2-91b9-d032b42158e4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.452111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b8849-7f98-41f2-91b9-d032b42158e4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.452111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b8849-7f98-41f2-91b9-d032b42158e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.474011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b01b8849-7f98-41f2-91b9-d032b42158e4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:08.475289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b01b8849-7f98-41f2-91b9-d032b42158e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:08.483859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1153/2293] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:08:08.513230 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec228ed-bb26-436d-8549-b72602ea4b3b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:08.528657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec228ed-bb26-436d-8549-b72602ea4b3b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:08.535557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:08.536188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:08.536472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:08.536744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:08.547118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:08.549847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:08.566838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1141/2294] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:11.726710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3789fd6-de30-4759-aaa1-77d8e12711e9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.727228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3789fd6-de30-4759-aaa1-77d8e12711e9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.727389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3789fd6-de30-4759-aaa1-77d8e12711e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.749412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e3789fd6-de30-4759-aaa1-77d8e12711e9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:11.750807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e3789fd6-de30-4759-aaa1-77d8e12711e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:11.764410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1154/2295] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:11.794985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:11.806773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b204ab-2310-4464-9e09-4815026b941b service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:11.812845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:11.813655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:11.813890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:11.814440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:11.830959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:11.832933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:11.843908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1142/2296] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:19.014710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8c3a-5e86-4a01-9fb4-2d0410032cbc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:19.016163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8c3a-5e86-4a01-9fb4-2d0410032cbc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:19.016911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8c3a-5e86-4a01-9fb4-2d0410032cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:19.044826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-29bd8c3a-5e86-4a01-9fb4-2d0410032cbc None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:19.046390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-29bd8c3a-5e86-4a01-9fb4-2d0410032cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:19.068677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1155/2297] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:08:19.104648 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:19.119324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5679-84ca-41e5-969d-8c55e624a87a service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:19.126472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:19.127346 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:19.127800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:19.128224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:19.139957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:19.143251 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:19.163357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1143/2298] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:23.271031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffa6f-312a-485c-99e9-feb83260692d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.272309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffa6f-312a-485c-99e9-feb83260692d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.273096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ffa6f-312a-485c-99e9-feb83260692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.299631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0b5ffa6f-312a-485c-99e9-feb83260692d None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:23.301200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0b5ffa6f-312a-485c-99e9-feb83260692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:23.310844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1156/2299] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:23.339607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:23.360948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e445e4f-687f-4394-a09c-213717011b8f service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:23.369032 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecaa7d9-2ce0-4900-99f1-8352d9629e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:23.370049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa7d9-2ce0-4900-99f1-8352d9629e59 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:23.370584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa7d9-2ce0-4900-99f1-8352d9629e59 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:23.371084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecaa7d9-2ce0-4900-99f1-8352d9629e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:23.385004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaa7d9-2ce0-4900-99f1-8352d9629e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:23.387002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecaa7d9-2ce0-4900-99f1-8352d9629e59 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:23.407510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1144/2300] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:24.949096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:24.949694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:24.949694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:24.977987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] MFA Rules not processed for user `b125e48efd9c4907be550b3f4077134c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:24.979389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:24.991159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1157/2301] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:08:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:25.474760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fe672-3751-4dc0-97b3-c75003fdef2a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:25.475306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fe672-3751-4dc0-97b3-c75003fdef2a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:25.475781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fe672-3751-4dc0-97b3-c75003fdef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:25.505299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-604fe672-3751-4dc0-97b3-c75003fdef2a None None] MFA Rules not processed for user `e6779c1c95ee4cdebbee060460dad5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:25.506630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-604fe672-3751-4dc0-97b3-c75003fdef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:25.585524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1145/2302] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:08:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:25.642113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:25.648551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:25.740870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc251198-a125-4bf1-9455-be4e46706391 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:25.748713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:25.750349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:25.750902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:25.751485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:25.753713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:25.771942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:25.774817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:25.801432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1158/2303] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:27.559581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:27.560161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:27.560161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:27.582577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:08:27.583832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:27.592341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1146/2304] 10.222.0.36 () {58 vars in 1020 bytes} [Mon Aug 1 17:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:08:27.620684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:27.633473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b0e06-0895-4ccc-9c81-e6877cdda9ca service glance] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:27.640564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:27.641281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:27.641558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:27.642055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:27.656171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:27.659588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:27.675553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1159/2305] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:28.115157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:28.117094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:28.203027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056cc45-48e7-41f0-903d-0285e40af057 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:28.208189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:28.208951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:28.209329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:28.209639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:28.211519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:28.228379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:28.230209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:28.242713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1147/2306] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:37.667469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=47 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:38.237260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=78 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:40.398101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:40.422138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924a553-e00b-42bf-9eb9-d9022a43bb51 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:40.431636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:40.432295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:40.432581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:40.432855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:40.435310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:40.448244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:40.450093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:40.461226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1160/2307] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:47.299240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:47.311681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ff72-6e1f-47be-8517-e4e5fc429fac service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:47.318054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:47.318765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:47.319044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:47.319318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:47.321220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:47.335354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:47.337000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:47.348793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1148/2308] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:08:50.455914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:08:53.345208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:08:53.357255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a9ff-057d-40d2-840e-862cb4c892a9 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:08:53.363913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:08:53.364540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:08:53.364822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:08:53.365096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:08:53.366958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:08:53.378217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:08:53.379821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:08:53.392041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1161/2309] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:08:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:08:57.342717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:03.384815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:03.792412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:03.793903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:03.812294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a697930-052b-4ccf-b15c-c166f96ebebd service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:03.817965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:03.818869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:03.819435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:03.819928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:03.822657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:03.838616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:03.840097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:03.853492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1149/2310] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:04.610204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:04.612364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:04.631906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104f54a-35e4-43a8-bf4c-755ab8cc5cbc service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:04.637732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:04.638843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:04.639129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:04.639409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] PATH_INFO: `/v3/users/c9dc388b0b624f5b9b8ebe2096c5c2f2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:04.640704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9dc388b0b624f5b9b8ebe2096c5c2f2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:04.642899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:04.705976 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9dc388b0b624f5b9b8ebe2096c5c2f2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:04.714761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9dc388b0b624f5b9b8ebe2096c5c2f2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:04.730047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9dc388b0b624f5b9b8ebe2096c5c2f2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:04.730949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9dc388b0b624f5b9b8ebe2096c5c2f2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:04.731653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-42367456-4f13-42ec-be69-985a25352cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9dc388b0b624f5b9b8ebe2096c5c2f2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:04.747866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1162/2311] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:04 2022] DELETE /identity/v3/users/c9dc388b0b624f5b9b8ebe2096c5c2f2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:04.964760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:04.985535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114554-43b8-492f-91b6-854934fff25a service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:05.062034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:05.063134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:05.063415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:05.063693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] PATH_INFO: `/v3/projects/843abee32d7542baaf3b446d8eb738d2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:05.065807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843abee32d7542baaf3b446d8eb738d2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:05.069786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:05.142608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843abee32d7542baaf3b446d8eb738d2', 'request_id': 'req-074008fd-3857-41c9-ae24-0b87ab359bb5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:05.151594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843abee32d7542baaf3b446d8eb738d2', 'request_id': 'req-074008fd-3857-41c9-ae24-0b87ab359bb5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:05.161090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843abee32d7542baaf3b446d8eb738d2', 'request_id': 'req-074008fd-3857-41c9-ae24-0b87ab359bb5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:05.185089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] The token cache is being invalidate because project 843abee32d7542baaf3b446d8eb738d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:05.185394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:05.186143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-074008fd-3857-41c9-ae24-0b87ab359bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:05.189126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1150/2312] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:04 2022] DELETE /identity/v3/projects/843abee32d7542baaf3b446d8eb738d2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:07.649571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448b198-cdff-4611-8c8f-084765fd92aa None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:07.650172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448b198-cdff-4611-8c8f-084765fd92aa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:07.650172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448b198-cdff-4611-8c8f-084765fd92aa None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:07.651624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1163/2313] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:09:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:09:07.682068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:07.683014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:07.683358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:07.704967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] MFA Rules not processed for user `9eb75b9333bf47328ac86c259b34becc`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:07.706477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:07.726083 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448b198-cdff-4611-8c8f-084765fd92aa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:07.730275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5448b198-cdff-4611-8c8f-084765fd92aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:07.808972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1151/2314] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:09:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:07.810474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448b198-cdff-4611-8c8f-084765fd92aa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:07.815500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:07.816149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:07.816435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:07.816711 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] PATH_INFO: `/v3/users/5c607e35877c4872a448c9a5e8a8a29c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:07.818405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c607e35877c4872a448c9a5e8a8a29c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:07.820472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:07.821675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:07.821805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:07.839597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4778f1-3d5a-48f4-8b6b-45b5629b5377 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:07.848502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:07.849450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:07.849818 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:07.850161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:07.864172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:07.866748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:07.876181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:07.885001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1152/2315] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:09:07.886489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c607e35877c4872a448c9a5e8a8a29c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:07.900536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c607e35877c4872a448c9a5e8a8a29c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:07.916772 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c607e35877c4872a448c9a5e8a8a29c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:07.917892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c607e35877c4872a448c9a5e8a8a29c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:07.918696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d7a37b8f-4581-456b-8147-fa1e3756a836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c607e35877c4872a448c9a5e8a8a29c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:07.921130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:07.945532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1164/2316] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:07 2022] DELETE /identity/v3/users/5c607e35877c4872a448c9a5e8a8a29c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:08.134671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.152761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d25e5-df7f-48c4-89a0-6cf65f589533 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.224073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.224840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.225210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.225497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] PATH_INFO: `/v3/projects/56f3f870120a4e5d92b73c363a3de04e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.226832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f3f870120a4e5d92b73c363a3de04e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.228794 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.277473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f3f870120a4e5d92b73c363a3de04e', 'request_id': 'req-8b164c3b-8e48-400a-8a7f-f89688ee6d88'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:08.283651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f3f870120a4e5d92b73c363a3de04e', 'request_id': 'req-8b164c3b-8e48-400a-8a7f-f89688ee6d88'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:08.290566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f3f870120a4e5d92b73c363a3de04e', 'request_id': 'req-8b164c3b-8e48-400a-8a7f-f89688ee6d88'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:08.301205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] The token cache is being invalidate because project 56f3f870120a4e5d92b73c363a3de04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:08.301490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:08.302139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b164c3b-8e48-400a-8a7f-f89688ee6d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:08.303663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1153/2317] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:08 2022] DELETE /identity/v3/projects/56f3f870120a4e5d92b73c363a3de04e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:08.308640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c670d-52cf-4116-936d-27b903c0c126 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.308935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c670d-52cf-4116-936d-27b903c0c126 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.309220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c670d-52cf-4116-936d-27b903c0c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.329945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fe2c670d-52cf-4116-936d-27b903c0c126 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:08.331125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fe2c670d-52cf-4116-936d-27b903c0c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:08.388767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1165/2318] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:08.396994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7ef9-4467-4463-9268-e3ab0524e17c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.397288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7ef9-4467-4463-9268-e3ab0524e17c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.397847 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f7ef9-4467-4463-9268-e3ab0524e17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.417125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8e2f7ef9-4467-4463-9268-e3ab0524e17c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:08.418365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e2f7ef9-4467-4463-9268-e3ab0524e17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:08.426979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1154/2319] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:08.431303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c670d-52cf-4116-936d-27b903c0c126 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.441671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c670d-52cf-4116-936d-27b903c0c126 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.446242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.446873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.447156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.447430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.448122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:08.448480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.450068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.461874 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1166/2320] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:09:08.466139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f7ef9-4467-4463-9268-e3ab0524e17c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.475463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f7ef9-4467-4463-9268-e3ab0524e17c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.480123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.480732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.481019 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.481297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.481967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.484813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.516585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1155/2321] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:08 2022] POST /identity/v3/projects => generated 374 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:08.517709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.528032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca68b4d-597e-4f33-8718-4cc32863659c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.583844 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.584368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.584650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.584927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.585598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.587549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.611157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1167/2322] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:08 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:08.615242 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.626195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c6aec-8978-43db-ab34-fe85f4fa7e40 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.631562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.632515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.632515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.632813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.633435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.635190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.647773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1156/2323] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:08 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:08.649962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.660766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275b0b2-c9c2-4d9c-ad67-da947d535390 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.665638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e3517-acf5-4c7b-8571-e5abfcd4d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.666304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3517-acf5-4c7b-8571-e5abfcd4d5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.666576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3517-acf5-4c7b-8571-e5abfcd4d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.666855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3517-acf5-4c7b-8571-e5abfcd4d5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.667555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e3517-acf5-4c7b-8571-e5abfcd4d5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.669142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e3517-acf5-4c7b-8571-e5abfcd4d5dc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.681039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1168/2324] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:08 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:08.685285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.696598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2001df-30b9-4a13-89c7-4e4dae6505b2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.701482 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.702302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.702658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.703050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] PATH_INFO: `/v3/projects/c5df680648c24372a883de147fce82de/users/f045267cd740454798812969aa6c3ef1/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.719670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5df680648c24372a883de147fce82de, user_id=f045267cd740454798812969aa6c3ef1, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.722447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.738580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1157/2325] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:08 2022] PUT /identity/v3/projects/c5df680648c24372a883de147fce82de/users/f045267cd740454798812969aa6c3ef1/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:08.751000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f114d9-d8d9-4605-a13f-fd751b7feeb8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.751282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f114d9-d8d9-4605-a13f-fd751b7feeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.751547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f114d9-d8d9-4605-a13f-fd751b7feeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.782203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-44f114d9-d8d9-4605-a13f-fd751b7feeb8 None None] MFA Rules not processed for user `f045267cd740454798812969aa6c3ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:08.783478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-44f114d9-d8d9-4605-a13f-fd751b7feeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:08.831433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:08.856082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1169/2326] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:08.861304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.902028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:08.939471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39a2a7-4ba6-4fb3-b9ca-b52ee9593f4c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:08.944216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:08.944854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:08.945139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:08.945422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:08.946105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:08.948056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:08.978737 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1158/2327] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:08 2022] POST /identity/v3/projects => generated 372 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:08.980267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f114d9-d8d9-4605-a13f-fd751b7feeb8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:08.991996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f114d9-d8d9-4605-a13f-fd751b7feeb8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:09.054559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:09.055188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.055469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.055742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.056406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:09.058362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:09.080746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1170/2328] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:08 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:09.084760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:09.095891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05ab3-a88b-431b-8f31-34fac5d6eba6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:09.101048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:09.101671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.101963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.102241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.102970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:09.104609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:09.116437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1159/2329] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:09 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:09.120938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:09.131604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6d1d2-9445-426e-ab6f-a5f24b758a4e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:09.136475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:09.137167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.137453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.137734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] PATH_INFO: `/v3/projects/05664ec3b0b84d549d721104dea4afd0/users/3018f43059ff4325880a6fb8e5899a1d/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.154879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05664ec3b0b84d549d721104dea4afd0, user_id=3018f43059ff4325880a6fb8e5899a1d, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:09.158075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:09.178243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1171/2330] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:09 2022] PUT /identity/v3/projects/05664ec3b0b84d549d721104dea4afd0/users/3018f43059ff4325880a6fb8e5899a1d/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:09.181877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:09.192437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bc243-e443-469b-9341-e9c41b607bc1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:09.249757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c05fe-6cd0-4de7-b187-088623007598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:09.250431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c05fe-6cd0-4de7-b187-088623007598 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.250716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c05fe-6cd0-4de7-b187-088623007598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.250986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c05fe-6cd0-4de7-b187-088623007598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.251677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c05fe-6cd0-4de7-b187-088623007598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:09.253281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c05fe-6cd0-4de7-b187-088623007598 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:09.263463 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1160/2331] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:09 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:09.268747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:09.280250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3cd46-7e84-450f-b0cb-4c810c0d4d10 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:09.285726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:09.286435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.286716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.286998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] PATH_INFO: `/v3/projects/05664ec3b0b84d549d721104dea4afd0/users/3018f43059ff4325880a6fb8e5899a1d/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.289008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05664ec3b0b84d549d721104dea4afd0, user_id=3018f43059ff4325880a6fb8e5899a1d, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:09.291732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:09.303000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1172/2332] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:09 2022] PUT /identity/v3/projects/05664ec3b0b84d549d721104dea4afd0/users/3018f43059ff4325880a6fb8e5899a1d/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:09.313268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73ea2d-eb8e-42de-89e2-f1213e5b95d2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.313555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73ea2d-eb8e-42de-89e2-f1213e5b95d2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.313833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73ea2d-eb8e-42de-89e2-f1213e5b95d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.349115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f73ea2d-eb8e-42de-89e2-f1213e5b95d2 None None] MFA Rules not processed for user `3018f43059ff4325880a6fb8e5899a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:09.350361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f73ea2d-eb8e-42de-89e2-f1213e5b95d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:09.423751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1161/2333] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:09.435056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:09.436870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:09.494967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2476-4ce2-4c15-974b-06a32cfd870a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:09.498700 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd09c4-95a7-491e-b721-542eb99117cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:09.499295 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd09c4-95a7-491e-b721-542eb99117cd service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.499574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd09c4-95a7-491e-b721-542eb99117cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.499847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd09c4-95a7-491e-b721-542eb99117cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.508808 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd09c4-95a7-491e-b721-542eb99117cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:09.510223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd09c4-95a7-491e-b721-542eb99117cd service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:09.520053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1173/2334] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:09.907613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73ea2d-eb8e-42de-89e2-f1213e5b95d2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:09.933770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:09.973785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73ea2d-eb8e-42de-89e2-f1213e5b95d2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:09.978526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:09.979173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:09.979457 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:09.979731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] PATH_INFO: `/v3/users/f045267cd740454798812969aa6c3ef1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:09.980918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f045267cd740454798812969aa6c3ef1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:09.982874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:10.030614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f045267cd740454798812969aa6c3ef1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.037789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f045267cd740454798812969aa6c3ef1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.038569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f045267cd740454798812969aa6c3ef1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.039408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f045267cd740454798812969aa6c3ef1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.048426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f045267cd740454798812969aa6c3ef1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.070348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1162/2335] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:09 2022] DELETE /identity/v3/users/f045267cd740454798812969aa6c3ef1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:10.073543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:10.074055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:10.074143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:10.094118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:10.095843 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:10.137994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:10.161033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1174/2336] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:10.171209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:10.173264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:10.232130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d343-5b4f-4340-985d-0f0728ec3c0c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:10.236335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:10.236956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:10.237241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:10.237519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:10.246381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:10.247805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:10.257884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1163/2337] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:10.525313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:10.526693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:10.540466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18beb4d-26a9-4677-9234-efef3a637b81 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:10.545271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:10.546043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:10.546353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:10.546669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] PATH_INFO: `/v3/projects/c5df680648c24372a883de147fce82de` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:10.548478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5df680648c24372a883de147fce82de)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:10.550459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:10.598055 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5df680648c24372a883de147fce82de', 'request_id': 'req-af0a9085-0268-4095-80c3-86f641f3828b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.604198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5df680648c24372a883de147fce82de', 'request_id': 'req-af0a9085-0268-4095-80c3-86f641f3828b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.612509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5df680648c24372a883de147fce82de', 'request_id': 'req-af0a9085-0268-4095-80c3-86f641f3828b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.624696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] The token cache is being invalidate because project c5df680648c24372a883de147fce82de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:10.625148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.625941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.627648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1175/2338] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:10 2022] DELETE /identity/v3/projects/c5df680648c24372a883de147fce82de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:10.631929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:10.641617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab9642-4a97-45e3-bec3-22f50a853f71 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:10.683883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:10.700265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:10.700838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:10.701143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:10.701442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] PATH_INFO: `/v3/users/3018f43059ff4325880a6fb8e5899a1d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:10.702623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3018f43059ff4325880a6fb8e5899a1d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:10.705056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:10.749056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3018f43059ff4325880a6fb8e5899a1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.755831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3018f43059ff4325880a6fb8e5899a1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.756521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3018f43059ff4325880a6fb8e5899a1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.757130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3018f43059ff4325880a6fb8e5899a1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.764180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a51cc3a-e71d-40d9-a18a-589789a8ac0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3018f43059ff4325880a6fb8e5899a1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:10.782418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1164/2339] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:10 2022] DELETE /identity/v3/users/3018f43059ff4325880a6fb8e5899a1d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:11.056307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.057744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:11.071445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9085-0268-4095-80c3-86f641f3828b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.129561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.130312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.130524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.130802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] PATH_INFO: `/v3/projects/05664ec3b0b84d549d721104dea4afd0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.132003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05664ec3b0b84d549d721104dea4afd0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.133939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.179758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05664ec3b0b84d549d721104dea4afd0', 'request_id': 'req-23554777-f204-4237-920b-b4f09c38b66b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:11.185947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05664ec3b0b84d549d721104dea4afd0', 'request_id': 'req-23554777-f204-4237-920b-b4f09c38b66b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:11.194862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05664ec3b0b84d549d721104dea4afd0', 'request_id': 'req-23554777-f204-4237-920b-b4f09c38b66b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:11.199507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:11.207784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] The token cache is being invalidate because project 05664ec3b0b84d549d721104dea4afd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:11.208094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:11.208987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-23554777-f204-4237-920b-b4f09c38b66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:11.210830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1176/2340] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:11 2022] DELETE /identity/v3/projects/05664ec3b0b84d549d721104dea4afd0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:11.215724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7e11d-3b11-4263-9d73-1bb9621dd652 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.216207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7e11d-3b11-4263-9d73-1bb9621dd652 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.216301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7e11d-3b11-4263-9d73-1bb9621dd652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.240454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-64c7e11d-3b11-4263-9d73-1bb9621dd652 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:11.242450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-64c7e11d-3b11-4263-9d73-1bb9621dd652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:11.310833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1165/2341] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:11.319687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2518-7fe2-4fe7-a618-0f4d2793ce13 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.320004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2518-7fe2-4fe7-a618-0f4d2793ce13 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.320286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2518-7fe2-4fe7-a618-0f4d2793ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.341968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-24ac2518-7fe2-4fe7-a618-0f4d2793ce13 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:11.343225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-24ac2518-7fe2-4fe7-a618-0f4d2793ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:11.351435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1177/2342] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:11.355793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7e11d-3b11-4263-9d73-1bb9621dd652 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.365862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7e11d-3b11-4263-9d73-1bb9621dd652 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.370523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.371145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.371425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.371703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.372401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:11.372708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.374425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.387481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1166/2343] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:09:11.395529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2518-7fe2-4fe7-a618-0f4d2793ce13 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.405326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2518-7fe2-4fe7-a618-0f4d2793ce13 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.410152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.410827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.411108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.411407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.412062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.413994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.441573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1178/2344] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:11 2022] POST /identity/v3/projects => generated 386 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:11.446096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.457371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce64bc-1263-4ea7-a664-e877c06428e6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.503662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:11.514544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.515518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.515857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.516361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.517053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.519059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.539703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1167/2345] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:11 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:11.543790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.554907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bee7d-3a88-4fcb-b258-cad0c67c6d4c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.559690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.560305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.560784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.560912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.561559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.563804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.574563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1179/2346] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:11 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:11.578528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.588496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd2c29-208c-44db-ab4f-1b75a86a138a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.593702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354a3ca-2930-4985-b34c-7138e264e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.594343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a3ca-2930-4985-b34c-7138e264e43b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.594631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a3ca-2930-4985-b34c-7138e264e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.594909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a3ca-2930-4985-b34c-7138e264e43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.595598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354a3ca-2930-4985-b34c-7138e264e43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.597193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354a3ca-2930-4985-b34c-7138e264e43b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.607680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1168/2347] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:11 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:11.612405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.622780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1832da7-df27-4988-83ce-543f6d8f1e57 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.628092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.628744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.629030 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.629302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] PATH_INFO: `/v3/projects/7555401f21694a5598cbac7801460733/users/603e6c45adcb4d53bf2738dd4a8e8b08/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.643787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7555401f21694a5598cbac7801460733, user_id=603e6c45adcb4d53bf2738dd4a8e8b08, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.646612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.659380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1180/2348] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:11 2022] PUT /identity/v3/projects/7555401f21694a5598cbac7801460733/users/603e6c45adcb4d53bf2738dd4a8e8b08/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:11.670763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd04e1b-b130-4328-a2a8-cfb5cb1161d9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.671129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd04e1b-b130-4328-a2a8-cfb5cb1161d9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.672012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd04e1b-b130-4328-a2a8-cfb5cb1161d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.699508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0cd04e1b-b130-4328-a2a8-cfb5cb1161d9 None None] MFA Rules not processed for user `603e6c45adcb4d53bf2738dd4a8e8b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:11.700735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0cd04e1b-b130-4328-a2a8-cfb5cb1161d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:11.764768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1169/2349] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:11.769319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.832094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1b7cf-adf9-4e6e-bbc6-b354ba2f58b9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.837039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.837699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.837986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.838298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.838963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.840908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.867486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1181/2350] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:11 2022] POST /identity/v3/projects => generated 386 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:11.871575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd04e1b-b130-4328-a2a8-cfb5cb1161d9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.882278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd04e1b-b130-4328-a2a8-cfb5cb1161d9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.939764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.940396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.940682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.940959 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.941640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.943602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:11.965265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1170/2351] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:11 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:11.970005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:11.986877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736c83-d9de-4c51-b431-5cac5c564818 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:11.991688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:11.992338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:11.992627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:11.992908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:11.993607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:11.995242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:12.005998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1182/2352] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:11 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:12.010491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:12.023334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d52b4-3c21-472a-80e9-e47771e64d2b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:12.027899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:12.028564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.028864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.029126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] PATH_INFO: `/v3/projects/e9d7ba0981d14f329e007ad0c18208b2/users/876a4f47f55a405eb18f08b760c199d4/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.044589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d7ba0981d14f329e007ad0c18208b2, user_id=876a4f47f55a405eb18f08b760c199d4, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:12.048057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:12.060495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1171/2353] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:12 2022] PUT /identity/v3/projects/e9d7ba0981d14f329e007ad0c18208b2/users/876a4f47f55a405eb18f08b760c199d4/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:12.064626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:12.079417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e8ff-c80c-4db7-8e63-fe5a5d424634 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:12.139087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8815-4ef1-48d2-b91b-e2787b8b349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:12.139809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8815-4ef1-48d2-b91b-e2787b8b349c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.139975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8815-4ef1-48d2-b91b-e2787b8b349c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.140245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8815-4ef1-48d2-b91b-e2787b8b349c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.140939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8815-4ef1-48d2-b91b-e2787b8b349c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:12.142560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8815-4ef1-48d2-b91b-e2787b8b349c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:12.152592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1183/2354] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:12 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:12.157413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:12.167595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20f5d-bc5b-4307-ad18-4508936344de admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:12.172874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:12.173531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.173814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.174090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] PATH_INFO: `/v3/projects/e9d7ba0981d14f329e007ad0c18208b2/users/876a4f47f55a405eb18f08b760c199d4/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.176063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d7ba0981d14f329e007ad0c18208b2, user_id=876a4f47f55a405eb18f08b760c199d4, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:12.178741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:12.189408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1172/2355] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:12 2022] PUT /identity/v3/projects/e9d7ba0981d14f329e007ad0c18208b2/users/876a4f47f55a405eb18f08b760c199d4/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:12.199745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d348e-5448-48df-9cd1-69d1dffddf3c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.200040 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d348e-5448-48df-9cd1-69d1dffddf3c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.200322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d348e-5448-48df-9cd1-69d1dffddf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.208182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:12.232218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ea2d348e-5448-48df-9cd1-69d1dffddf3c None None] MFA Rules not processed for user `876a4f47f55a405eb18f08b760c199d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:12.233439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ea2d348e-5448-48df-9cd1-69d1dffddf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:12.305323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1184/2356] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:12.317113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:12.318999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:12.333706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:12.378513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb1a65-712b-4bb1-85c5-c1d5ea62af4d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:12.382197 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a413b-38cb-40dc-b2a8-8f080abcce8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:12.382853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a413b-38cb-40dc-b2a8-8f080abcce8d service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.383142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a413b-38cb-40dc-b2a8-8f080abcce8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.383422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a413b-38cb-40dc-b2a8-8f080abcce8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.393828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a413b-38cb-40dc-b2a8-8f080abcce8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:12.395312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a413b-38cb-40dc-b2a8-8f080abcce8d service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:12.405166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1173/2357] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:12.475107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d348e-5448-48df-9cd1-69d1dffddf3c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:12.539899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d348e-5448-48df-9cd1-69d1dffddf3c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:12.544543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:12.545208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.545486 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.545784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] PATH_INFO: `/v3/users/603e6c45adcb4d53bf2738dd4a8e8b08` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.547020 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=603e6c45adcb4d53bf2738dd4a8e8b08)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:12.549004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:12.597837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603e6c45adcb4d53bf2738dd4a8e8b08'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:12.604899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603e6c45adcb4d53bf2738dd4a8e8b08'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:12.618763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603e6c45adcb4d53bf2738dd4a8e8b08'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:12.619875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603e6c45adcb4d53bf2738dd4a8e8b08'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:12.620720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603e6c45adcb4d53bf2738dd4a8e8b08'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:12.636356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1185/2358] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:12 2022] DELETE /identity/v3/users/603e6c45adcb4d53bf2738dd4a8e8b08 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:12.642113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.642438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.642724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.663308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:12.664537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:12.725466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1174/2359] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:12.735392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:12.736829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:12.747064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:12.800128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a00a8-10a6-4839-9d1c-d00eafdb7b57 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:12.803906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:12.804531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:12.804812 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:12.805090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:12.817066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:12.818471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:12.828875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1186/2360] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:09:13.113588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:13.115428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:13.131556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596203ee-1fc5-4776-b370-43ecaf0e3691 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:13.137318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:13.138179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:13.138511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:13.138795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] PATH_INFO: `/v3/projects/7555401f21694a5598cbac7801460733` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:13.140149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7555401f21694a5598cbac7801460733)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:13.142124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:13.196199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7555401f21694a5598cbac7801460733', 'request_id': 'req-ebbb47dc-7483-492c-b961-9c79ed4e2378'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.202666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7555401f21694a5598cbac7801460733', 'request_id': 'req-ebbb47dc-7483-492c-b961-9c79ed4e2378'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.211590 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7555401f21694a5598cbac7801460733', 'request_id': 'req-ebbb47dc-7483-492c-b961-9c79ed4e2378'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.224249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] The token cache is being invalidate because project 7555401f21694a5598cbac7801460733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:13.224676 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.225484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.227470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1175/2361] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:13 2022] DELETE /identity/v3/projects/7555401f21694a5598cbac7801460733 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:13.231570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:13.242800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab39263-06d2-4a5d-9f38-4ff4e23a9b24 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:13.302387 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:13.303042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:13.303327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:13.303609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] PATH_INFO: `/v3/users/876a4f47f55a405eb18f08b760c199d4` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:13.304809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=876a4f47f55a405eb18f08b760c199d4)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:13.307811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:13.361566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876a4f47f55a405eb18f08b760c199d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.368870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876a4f47f55a405eb18f08b760c199d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.385249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876a4f47f55a405eb18f08b760c199d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.386244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876a4f47f55a405eb18f08b760c199d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.387153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d70b0f30-a80f-4486-960f-d62350869a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876a4f47f55a405eb18f08b760c199d4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:13.402105 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1187/2362] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:13 2022] DELETE /identity/v3/users/876a4f47f55a405eb18f08b760c199d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:13.955923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:13.957401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:13.977394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb47dc-7483-492c-b961-9c79ed4e2378 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.028543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:14.058226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.059722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.059722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.059722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] PATH_INFO: `/v3/projects/e9d7ba0981d14f329e007ad0c18208b2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.060766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d7ba0981d14f329e007ad0c18208b2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.063307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.117735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d7ba0981d14f329e007ad0c18208b2', 'request_id': 'req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:14.124091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d7ba0981d14f329e007ad0c18208b2', 'request_id': 'req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:14.132893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d7ba0981d14f329e007ad0c18208b2', 'request_id': 'req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:14.147978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] The token cache is being invalidate because project e9d7ba0981d14f329e007ad0c18208b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:14.148266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:14.148946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-471d5ae2-5d0b-4730-aa9a-1151b06ca0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:14.150479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1176/2363] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:13 2022] DELETE /identity/v3/projects/e9d7ba0981d14f329e007ad0c18208b2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:14.155619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1cc25-d1e6-4eef-b760-bc57e6ee324a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.155893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1cc25-d1e6-4eef-b760-bc57e6ee324a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.156287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1cc25-d1e6-4eef-b760-bc57e6ee324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.176393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-26a1cc25-d1e6-4eef-b760-bc57e6ee324a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:14.177617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-26a1cc25-d1e6-4eef-b760-bc57e6ee324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:14.202410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:14.247065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1188/2364] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:14.255789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2392-c027-431b-95de-621f5462fa38 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.256084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2392-c027-431b-95de-621f5462fa38 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.256367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2392-c027-431b-95de-621f5462fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.277689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9d7e2392-c027-431b-95de-621f5462fa38 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:14.278984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9d7e2392-c027-431b-95de-621f5462fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:14.287164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1177/2365] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:14.291819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1cc25-d1e6-4eef-b760-bc57e6ee324a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:14.301741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1cc25-d1e6-4eef-b760-bc57e6ee324a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.306566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.307173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.307454 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.307752 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.308441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:14.308742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.310633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.322743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1189/2366] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:09:14.327557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2392-c027-431b-95de-621f5462fa38 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:14.340025 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2392-c027-431b-95de-621f5462fa38 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.345296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.346110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.346554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.347021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.347831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.349835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.379424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1178/2367] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:14 2022] POST /identity/v3/projects => generated 374 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:14.383810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:14.400222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97105ef4-5559-44d6-8985-df95cfa8e99f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.457022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.457536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.457822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.458098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.458813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.460750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.485275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1190/2368] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:14 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:14.489769 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:14.502600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33527-ae8a-4f68-9a56-c231e139f9f8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.507726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.508442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.508729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.509006 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.509707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.511366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.522245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1179/2369] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:14 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:14.527227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:14.540877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf2ba4-ff6e-47c1-914b-4fcbcde981fa admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.545803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642c86-3f16-4667-b354-3db7eab22172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.547006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642c86-3f16-4667-b354-3db7eab22172 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.547292 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642c86-3f16-4667-b354-3db7eab22172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.547595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642c86-3f16-4667-b354-3db7eab22172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.548310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642c86-3f16-4667-b354-3db7eab22172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.549926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642c86-3f16-4667-b354-3db7eab22172 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.563200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1191/2370] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:14 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:14.568280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:14.578771 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fe0a1-b0b0-44fc-a3f9-69a680464cb4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.583563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.584325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.584537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.584819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] PATH_INFO: `/v3/projects/2e9dbb6c8744418ab14ef1ce1be88578/users/46dfc6ad2b45488b98e45481eda6c242/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.602449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9dbb6c8744418ab14ef1ce1be88578, user_id=46dfc6ad2b45488b98e45481eda6c242, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.606302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.620949 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1180/2371] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:14 2022] PUT /identity/v3/projects/2e9dbb6c8744418ab14ef1ce1be88578/users/46dfc6ad2b45488b98e45481eda6c242/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:14.633543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b3d7-41f9-4df1-b7be-a2a54be90192 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.633838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b3d7-41f9-4df1-b7be-a2a54be90192 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.634124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b3d7-41f9-4df1-b7be-a2a54be90192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.668116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8ac8b3d7-41f9-4df1-b7be-a2a54be90192 None None] MFA Rules not processed for user `46dfc6ad2b45488b98e45481eda6c242`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:14.669385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8ac8b3d7-41f9-4df1-b7be-a2a54be90192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:14.735703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1192/2372] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:14.747434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:14.749215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:14.809013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc2596-bc26-4d89-ba21-ba705c230e74 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:14.813432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ff0f8-df28-4683-804c-c3abfb445fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:14.814070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ff0f8-df28-4683-804c-c3abfb445fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:14.814407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ff0f8-df28-4683-804c-c3abfb445fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:14.814689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ff0f8-df28-4683-804c-c3abfb445fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:14.823541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ff0f8-df28-4683-804c-c3abfb445fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:14.824981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ff0f8-df28-4683-804c-c3abfb445fe4 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:14.838311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1181/2373] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:18.054494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b3d7-41f9-4df1-b7be-a2a54be90192 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:18.089593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:18.132492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b3d7-41f9-4df1-b7be-a2a54be90192 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:18.137142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:18.138697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:18.138697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:18.138697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] PATH_INFO: `/v3/users/46dfc6ad2b45488b98e45481eda6c242` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:18.139668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dfc6ad2b45488b98e45481eda6c242)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:18.141601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:18.194579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dfc6ad2b45488b98e45481eda6c242'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.201322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dfc6ad2b45488b98e45481eda6c242'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.214814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dfc6ad2b45488b98e45481eda6c242'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.215605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dfc6ad2b45488b98e45481eda6c242'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.216233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dfc6ad2b45488b98e45481eda6c242'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.230978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1193/2374] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:18 2022] DELETE /identity/v3/users/46dfc6ad2b45488b98e45481eda6c242 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:18.235615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:18.236096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:18.236232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:18.249295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:18.255618 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:18.257343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:18.318153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1182/2375] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:18.328352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:18.329769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:18.388314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6c8ab-d8c4-49e8-baae-63a90d3559d8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:18.392608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20188a-c7b2-4ec3-931a-8c5fe03bfe88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:18.393199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20188a-c7b2-4ec3-931a-8c5fe03bfe88 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:18.393478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20188a-c7b2-4ec3-931a-8c5fe03bfe88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:18.393754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20188a-c7b2-4ec3-931a-8c5fe03bfe88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:18.403605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20188a-c7b2-4ec3-931a-8c5fe03bfe88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:18.405670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20188a-c7b2-4ec3-931a-8c5fe03bfe88 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:18.416718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1194/2376] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:18.792447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:18.794288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:18.817356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69191da1-cc68-40c8-9e66-57c6db87265b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:18.823757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:18.824426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:18.824738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:18.825065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] PATH_INFO: `/v3/projects/2e9dbb6c8744418ab14ef1ce1be88578` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:18.826142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9dbb6c8744418ab14ef1ce1be88578)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:18.828680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:18.885489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9dbb6c8744418ab14ef1ce1be88578', 'request_id': 'req-5200e3a1-c704-47f6-a80a-5cd80f19746e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.897758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9dbb6c8744418ab14ef1ce1be88578', 'request_id': 'req-5200e3a1-c704-47f6-a80a-5cd80f19746e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.907195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9dbb6c8744418ab14ef1ce1be88578', 'request_id': 'req-5200e3a1-c704-47f6-a80a-5cd80f19746e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.920227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] The token cache is being invalidate because project 2e9dbb6c8744418ab14ef1ce1be88578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:18.920517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.921209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5200e3a1-c704-47f6-a80a-5cd80f19746e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:18.923624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1183/2377] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:18 2022] DELETE /identity/v3/projects/2e9dbb6c8744418ab14ef1ce1be88578 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:18.928499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b76e-4a10-45a0-9827-18569ca2fad9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:18.928786 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b76e-4a10-45a0-9827-18569ca2fad9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:18.929062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b76e-4a10-45a0-9827-18569ca2fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:18.956248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8477b76e-4a10-45a0-9827-18569ca2fad9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:18.958136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8477b76e-4a10-45a0-9827-18569ca2fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:19.010678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:19.034560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1195/2378] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:19.042479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082bf5b-c09c-4e02-a9d5-580041fef0d7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.042838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082bf5b-c09c-4e02-a9d5-580041fef0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.043129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082bf5b-c09c-4e02-a9d5-580041fef0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.068123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1082bf5b-c09c-4e02-a9d5-580041fef0d7 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:19.069383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1082bf5b-c09c-4e02-a9d5-580041fef0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:19.079630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1184/2379] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:19.083911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b76e-4a10-45a0-9827-18569ca2fad9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.101111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b76e-4a10-45a0-9827-18569ca2fad9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.109954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.110965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.111256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.111664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.112338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:19.112669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.114456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.128878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1196/2380] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:09:19.133616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082bf5b-c09c-4e02-a9d5-580041fef0d7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.145571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082bf5b-c09c-4e02-a9d5-580041fef0d7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.152804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.153829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.154700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.154836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.156696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.160055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.204710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1185/2381] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:19 2022] POST /identity/v3/projects => generated 378 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:19.206704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.220892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ab735-4406-40a5-abf8-feb94909ec01 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.278370 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.279171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.280148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.280148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.280549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.283394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.310008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1197/2382] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:19 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:19.312556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.324887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876df9d0-197d-44c3-b94f-bb4e00296feb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.331008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.331646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.331928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.332202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.332898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.334542 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.347480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1186/2383] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:19 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:19.352974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.364694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea681a21-2fe3-4298-bf25-e37587a5fbe8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.369888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c3a1-c2db-458f-9197-211942578852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.370576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c3a1-c2db-458f-9197-211942578852 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.370988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c3a1-c2db-458f-9197-211942578852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.371142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c3a1-c2db-458f-9197-211942578852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.371859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c3a1-c2db-458f-9197-211942578852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.374829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c3a1-c2db-458f-9197-211942578852 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.388112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1198/2384] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:19 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:19.393074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.404821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee7a87-7d1f-4ebf-b92d-51cebb818103 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.411620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476d80-2390-4752-a9e4-22b4a5f922d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.412397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476d80-2390-4752-a9e4-22b4a5f922d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.412681 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476d80-2390-4752-a9e4-22b4a5f922d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.412963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476d80-2390-4752-a9e4-22b4a5f922d4 admin admin] PATH_INFO: `/v3/projects/ec07d715e6f9475ca1254c498390ef6a/users/07e85f40032d4a2aa6ed1213c25a71a4/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.431328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476d80-2390-4752-a9e4-22b4a5f922d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec07d715e6f9475ca1254c498390ef6a, user_id=07e85f40032d4a2aa6ed1213c25a71a4, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.434711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476d80-2390-4752-a9e4-22b4a5f922d4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.452653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1187/2385] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:19 2022] PUT /identity/v3/projects/ec07d715e6f9475ca1254c498390ef6a/users/07e85f40032d4a2aa6ed1213c25a71a4/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:19.466614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e7d1-6429-4c56-ba8c-3e20abd28fcf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.466911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e7d1-6429-4c56-ba8c-3e20abd28fcf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.467195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e7d1-6429-4c56-ba8c-3e20abd28fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.476994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.477427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.477868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.501195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fd03e7d1-6429-4c56-ba8c-3e20abd28fcf None None] MFA Rules not processed for user `07e85f40032d4a2aa6ed1213c25a71a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:19.502567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fd03e7d1-6429-4c56-ba8c-3e20abd28fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:19.502792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:19.504293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:19.554979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:19.594420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1199/2386] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:19.606788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e7d1-6429-4c56-ba8c-3e20abd28fcf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.615259 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1188/2387] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:19.685372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:19.692917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.695345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:19.729037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e7d1-6429-4c56-ba8c-3e20abd28fcf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.735734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.736506 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.736793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.737333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.738029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.740130 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.777927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1200/2388] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:19 2022] POST /identity/v3/projects => generated 376 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:19.782965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.808140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf1b21-9f38-4efd-9554-bb50581d9d36 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.882187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f67cc-c735-4d17-889c-8a64a702284f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.888253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.888896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.889185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.889457 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.890232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.892983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.916238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdab18e-c8a0-476a-805c-31e61cbc0af7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.917350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdab18e-c8a0-476a-805c-31e61cbc0af7 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.917969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdab18e-c8a0-476a-805c-31e61cbc0af7 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.918739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdab18e-c8a0-476a-805c-31e61cbc0af7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.918909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1201/2389] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:19 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:19.923401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.933814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddf41f-1de4-4d62-b717-89bb78c9aebc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.939363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.939989 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.940328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.940719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.941424 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.943208 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:19.962314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1202/2390] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:19 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:19.967704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:19.979328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e741e8-aaca-4d95-9eb4-313cbd901a13 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:19.986939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:19.988033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:19.988429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:19.988925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:19.990026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:19.992566 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.006296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1203/2391] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:19 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:20.010571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:20.017312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdab18e-c8a0-476a-805c-31e61cbc0af7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.018980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdab18e-c8a0-476a-805c-31e61cbc0af7 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.023338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171cf93-734a-4037-a534-c320eed2f7a1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:20.030905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1189/2392] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:09:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:09:20.031373 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:20.032484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.033034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.033621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] PATH_INFO: `/v3/projects/2a18a207123c4ba4b2c4335891d9ba84/users/57acd14280b048229d4a031b677e20d3/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.058882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a18a207123c4ba4b2c4335891d9ba84, user_id=57acd14280b048229d4a031b677e20d3, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.064460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.105026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1204/2393] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:20 2022] PUT /identity/v3/projects/2a18a207123c4ba4b2c4335891d9ba84/users/57acd14280b048229d4a031b677e20d3/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:20.128018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360818-4575-4b9e-94d3-c0f2c9643617 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.128445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360818-4575-4b9e-94d3-c0f2c9643617 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.128937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6360818-4575-4b9e-94d3-c0f2c9643617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.183257 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f6360818-4575-4b9e-94d3-c0f2c9643617 None None] MFA Rules not processed for user `57acd14280b048229d4a031b677e20d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:20.185726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f6360818-4575-4b9e-94d3-c0f2c9643617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:20.197662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:20.304442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1190/2394] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:20.310985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:20.423178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746da70d-4123-4335-a677-1acfb285254f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:20.438739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:20.439430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.439767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.440126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.441075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.443302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.464648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:20.493877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1205/2395] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:20 2022] POST /identity/v3/projects => generated 378 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:20.495545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360818-4575-4b9e-94d3-c0f2c9643617 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:20.517210 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6360818-4575-4b9e-94d3-c0f2c9643617 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:20.597531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:20.598166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.598495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.598775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.599490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.601529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.638039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1191/2396] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:20 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:20.642891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:20.661441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d03a5-b387-4a56-af24-115f591da41a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:20.673375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:20.674428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.674914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.675272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.676514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.679028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.699721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1206/2397] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:20 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:20.704046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:20.720321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db354c-96c8-4e54-a903-ebf7605db967 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:20.724535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:20.725346 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.725725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.726107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] PATH_INFO: `/v3/projects/751abafa97bc47b2a05d39b177d47322/users/06c381b570014091b2459e8fe4dcebda/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.749080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=751abafa97bc47b2a05d39b177d47322, user_id=06c381b570014091b2459e8fe4dcebda, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.753791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.778519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1192/2398] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:20 2022] PUT /identity/v3/projects/751abafa97bc47b2a05d39b177d47322/users/06c381b570014091b2459e8fe4dcebda/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:20.782986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:20.797257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08618-a567-46d9-b43e-3b203b91f166 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:20.877904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a7f9e-7847-4615-b286-85791f772487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:20.878809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7f9e-7847-4615-b286-85791f772487 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.879224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7f9e-7847-4615-b286-85791f772487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.879578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a7f9e-7847-4615-b286-85791f772487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.880409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a7f9e-7847-4615-b286-85791f772487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.886001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a7f9e-7847-4615-b286-85791f772487 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.896725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1207/2399] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:20 2022] GET /identity/v3/roles => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:20.898971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:20.916954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69257039-61a7-48e3-a56a-e91569361bf0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:20.922516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:20.923307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.923662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.924015 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] PATH_INFO: `/v3/projects/751abafa97bc47b2a05d39b177d47322/users/06c381b570014091b2459e8fe4dcebda/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:20.926116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=751abafa97bc47b2a05d39b177d47322, user_id=06c381b570014091b2459e8fe4dcebda, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:20.932263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:20.963014 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1193/2400] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:20 2022] PUT /identity/v3/projects/751abafa97bc47b2a05d39b177d47322/users/06c381b570014091b2459e8fe4dcebda/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:20.964290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:20.964656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:20.965046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:21.044820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] MFA Rules not processed for user `06c381b570014091b2459e8fe4dcebda`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:21.050560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:21.164998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:21.167875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:21.178749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1208/2401] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:21.198789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:21.210747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:21.252814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:21.284591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f523b-5382-4005-8a7e-59988cf01740 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:21.288820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961a378-9b40-4e71-bfc7-270270d96438 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:21.290578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:21.291427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:21.291706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:21.291979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:21.293790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:21.293926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:21.294637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:21.295206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:21.295712 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:21.308284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:21.310004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:21.324803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1194/2402] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:09:21.333218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:21.391625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:21.393195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:21.403726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1209/2403] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:23.090436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:23.092364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:23.105556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3091d-5062-4892-a6ac-8d2005b53d4f service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:23.109391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:23.110034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:23.110357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:23.110647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:23.197493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:23.200181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:23.218586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1195/2404] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:24.279344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:24.289948 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4538df-949e-4abd-93bf-39acd2d302a7 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:24.294602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:24.295314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:24.295573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:24.295866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:24.314069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:24.315657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:24.331602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1210/2405] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:26.443944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:26.445783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:26.531686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5be580-7985-4dc7-bb24-60702ae1b146 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:26.539434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f2156-4f22-4b80-9b63-c1727a80885a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:26.548772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f2156-4f22-4b80-9b63-c1727a80885a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:26.549746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f2156-4f22-4b80-9b63-c1727a80885a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:26.550401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f2156-4f22-4b80-9b63-c1727a80885a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:26.564594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-900f2156-4f22-4b80-9b63-c1727a80885a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:26.581252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f2156-4f22-4b80-9b63-c1727a80885a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:26.583116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f2156-4f22-4b80-9b63-c1727a80885a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:26.593633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1196/2406] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:09:28.803085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:28.875253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73568a-7249-4ef9-9919-343912c43d47 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:28.880731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:28.881408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:28.881695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:28.881975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] PATH_INFO: `/v3/users/07e85f40032d4a2aa6ed1213c25a71a4` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:28.883243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e85f40032d4a2aa6ed1213c25a71a4)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:28.885229 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:28.977389 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e85f40032d4a2aa6ed1213c25a71a4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:28.988043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e85f40032d4a2aa6ed1213c25a71a4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.034177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e85f40032d4a2aa6ed1213c25a71a4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.057679 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e85f40032d4a2aa6ed1213c25a71a4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.058641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e85f40032d4a2aa6ed1213c25a71a4'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.084777 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1211/2407] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:28 2022] DELETE /identity/v3/users/07e85f40032d4a2aa6ed1213c25a71a4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:29.090942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:29.091715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:29.091715 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:29.122103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:29.123631 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:29.218703 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1197/2408] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:29.233165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:29.235792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:29.345840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:29.391210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88571c-d275-497b-9581-6d8c0bb20f63 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:29.395802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:29.396439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:29.396727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:29.397007 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:29.411862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:29.413330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:29.437442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1212/2409] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:09:29.814942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:29.817845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:29.848159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247248f-54a0-44d0-9c4c-3235827d0492 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:29.854474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:29.855276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:29.855638 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:29.856067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] PATH_INFO: `/v3/projects/ec07d715e6f9475ca1254c498390ef6a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:29.857893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec07d715e6f9475ca1254c498390ef6a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:29.860208 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:29.896144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:29.945918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec07d715e6f9475ca1254c498390ef6a', 'request_id': 'req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.955495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec07d715e6f9475ca1254c498390ef6a', 'request_id': 'req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.966907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec07d715e6f9475ca1254c498390ef6a', 'request_id': 'req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.981948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] The token cache is being invalidate because project ec07d715e6f9475ca1254c498390ef6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:29.982768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.984270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:29.986100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1198/2410] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:29 2022] DELETE /identity/v3/projects/ec07d715e6f9475ca1254c498390ef6a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:29.990233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:30.002306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad43a9-79cb-48f1-b42b-86e99c3f20e6 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:30.085771 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:30.086726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:30.087238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:30.087524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] PATH_INFO: `/v3/users/57acd14280b048229d4a031b677e20d3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:30.088822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57acd14280b048229d4a031b677e20d3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:30.090863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:30.175558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57acd14280b048229d4a031b677e20d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.183960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57acd14280b048229d4a031b677e20d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.198906 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57acd14280b048229d4a031b677e20d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.199646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57acd14280b048229d4a031b677e20d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.200307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57acd14280b048229d4a031b677e20d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.215569 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1213/2411] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:29 2022] DELETE /identity/v3/users/57acd14280b048229d4a031b677e20d3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:30.595240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:30.601836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:30.617516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de49c6f-66f4-4e05-a8d0-ceb781d6e26f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:30.681091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:30.681802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:30.682280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:30.682417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] PATH_INFO: `/v3/projects/2a18a207123c4ba4b2c4335891d9ba84` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:30.686100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a18a207123c4ba4b2c4335891d9ba84)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:30.689434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:30.744828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a18a207123c4ba4b2c4335891d9ba84', 'request_id': 'req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.751085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a18a207123c4ba4b2c4335891d9ba84', 'request_id': 'req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.758371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a18a207123c4ba4b2c4335891d9ba84', 'request_id': 'req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.769097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] The token cache is being invalidate because project 2a18a207123c4ba4b2c4335891d9ba84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:30.769390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.770069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.771672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1199/2412] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:30 2022] DELETE /identity/v3/projects/2a18a207123c4ba4b2c4335891d9ba84 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:30.776396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:30.777934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:30.792120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab6346-9b32-47f8-8555-9b3fac2c6033 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:30.843851 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:30.861429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:30.862361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:30.862759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:30.863151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] PATH_INFO: `/v3/users/06c381b570014091b2459e8fe4dcebda` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:30.864740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c381b570014091b2459e8fe4dcebda)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:30.867668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:30.922070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c381b570014091b2459e8fe4dcebda'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.929171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c381b570014091b2459e8fe4dcebda'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.941093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c381b570014091b2459e8fe4dcebda'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.941815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c381b570014091b2459e8fe4dcebda'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.942471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9483bb51-7586-4f2d-91c6-98dca4820603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c381b570014091b2459e8fe4dcebda'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:30.956760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1214/2413] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:30 2022] DELETE /identity/v3/users/06c381b570014091b2459e8fe4dcebda => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:31.290334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:31.291911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:31.308522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fe5a7-5f24-4ff3-87bf-67a7f5fe0201 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:31.366912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:31.398656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:31.399388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.399721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.400047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] PATH_INFO: `/v3/projects/751abafa97bc47b2a05d39b177d47322` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.401336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=751abafa97bc47b2a05d39b177d47322)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:31.403478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:31.468170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751abafa97bc47b2a05d39b177d47322', 'request_id': 'req-a70751e9-0894-499d-a5ae-a2784aa998ff'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:31.475599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751abafa97bc47b2a05d39b177d47322', 'request_id': 'req-a70751e9-0894-499d-a5ae-a2784aa998ff'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:31.484736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751abafa97bc47b2a05d39b177d47322', 'request_id': 'req-a70751e9-0894-499d-a5ae-a2784aa998ff'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:31.497384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] The token cache is being invalidate because project 751abafa97bc47b2a05d39b177d47322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:31.497682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:31.498460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a70751e9-0894-499d-a5ae-a2784aa998ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:31.500546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1200/2414] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:31 2022] DELETE /identity/v3/projects/751abafa97bc47b2a05d39b177d47322 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:31.507079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6189-1fa1-47f9-9534-897aece1174f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.507598 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6189-1fa1-47f9-9534-897aece1174f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.507695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6189-1fa1-47f9-9534-897aece1174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.528686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-233f6189-1fa1-47f9-9534-897aece1174f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:31.529905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-233f6189-1fa1-47f9-9534-897aece1174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:31.595641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1215/2415] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:31.663622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec061f16-9188-41e0-9768-357ee9bf3255 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.664171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec061f16-9188-41e0-9768-357ee9bf3255 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.664171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec061f16-9188-41e0-9768-357ee9bf3255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.685188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ec061f16-9188-41e0-9768-357ee9bf3255 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:31.687085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ec061f16-9188-41e0-9768-357ee9bf3255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:31.695462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1201/2416] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:31.699996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6189-1fa1-47f9-9534-897aece1174f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:31.710675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6189-1fa1-47f9-9534-897aece1174f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:31.715422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:31.716076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.716326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.716609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.717327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:31.717613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:31.719313 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:31.736086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1216/2417] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:09:31.742652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec061f16-9188-41e0-9768-357ee9bf3255 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:31.754083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec061f16-9188-41e0-9768-357ee9bf3255 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:31.758891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:31.759538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.759828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.760110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.760783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:31.762734 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:31.793866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1202/2418] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:31 2022] POST /identity/v3/projects => generated 392 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:31.797967 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:31.808434 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812407-2a72-4ba9-9052-fe71ad4c3cfe admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:31.864699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:31.874521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:31.875562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.876503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.877148 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.878240 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:31.880400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:31.906555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1217/2419] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:31 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:31.910931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:31.927893 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355914b-6c87-4793-abe4-29be0f059c21 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:31.932719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:31.933344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.933622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.933895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.934692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:31.936340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:31.947289 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1203/2420] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:31 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:31.951493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:31.963044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f196c33-b91b-4a8b-bb78-2575100d1b39 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:31.967900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75495-47b1-4635-987a-e80d9a379673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:31.968512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75495-47b1-4635-987a-e80d9a379673 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:31.968797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75495-47b1-4635-987a-e80d9a379673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:31.969106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75495-47b1-4635-987a-e80d9a379673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:31.969801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a75495-47b1-4635-987a-e80d9a379673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:31.971443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a75495-47b1-4635-987a-e80d9a379673 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:31.982708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1218/2421] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:31 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:31.989557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:32.000328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafe3a2-cf85-4bcd-8e1c-261d54b8ac18 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:32.005061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:32.005733 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:32.006028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:32.006343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] PATH_INFO: `/v3/projects/47b9bc87ec5d45119eff4d4c6c7340e9/users/2c72e86fa24945eb950a192371eab08a/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:32.024881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b9bc87ec5d45119eff4d4c6c7340e9, user_id=2c72e86fa24945eb950a192371eab08a, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:32.027608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:32.050721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1204/2422] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:31 2022] PUT /identity/v3/projects/47b9bc87ec5d45119eff4d4c6c7340e9/users/2c72e86fa24945eb950a192371eab08a/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:32.062013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:32.062421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:32.062714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:32.099754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] MFA Rules not processed for user `2c72e86fa24945eb950a192371eab08a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:32.101435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:32.195025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1219/2423] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:32.208444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:32.210833 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:32.282121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab445-3fd7-48ca-b981-602955db3d7f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:32.291621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:32.291852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:32.292188 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:32.292687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:32.305911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:32.307398 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:32.317655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1205/2424] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:33.652156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:33.654657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:33.751940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:33.753380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:33.771439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:33.782009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3250a2f-4c85-4cc0-bcc1-89401d49b438 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:33.789204 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:33.790122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:33.790643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:33.791093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:33.793615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:33.815094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:33.816918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:33.831086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1220/2425] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:33.967394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58da7b1-a9c1-49ed-8afd-4b54feadf5d3 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:33.984445 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c406-16c9-40e8-a4ab-f1840e94abd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:33.986194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c406-16c9-40e8-a4ab-f1840e94abd6 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:33.986194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c406-16c9-40e8-a4ab-f1840e94abd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:33.986410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c406-16c9-40e8-a4ab-f1840e94abd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:33.989418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2eb9c406-16c9-40e8-a4ab-f1840e94abd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:34.106669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9c406-16c9-40e8-a4ab-f1840e94abd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:34.109859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9c406-16c9-40e8-a4ab-f1840e94abd6 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:34.125164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1206/2426] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:36.542692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:36.546709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:36.628528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:36.637542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9e12c-d95c-4bac-b957-08cd0e56025a service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:36.645653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb886430-a190-4603-a781-e7f48d1b8ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:36.646601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886430-a190-4603-a781-e7f48d1b8ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:36.647010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886430-a190-4603-a781-e7f48d1b8ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:36.647770 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886430-a190-4603-a781-e7f48d1b8ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:36.653263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cb886430-a190-4603-a781-e7f48d1b8ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:36.669639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb886430-a190-4603-a781-e7f48d1b8ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:36.671892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb886430-a190-4603-a781-e7f48d1b8ab2 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:36.688886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1221/2427] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:36.870526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e5f9-0e63-44b1-83c8-20070ff0450b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:36.871399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e5f9-0e63-44b1-83c8-20070ff0450b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:36.872146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e5f9-0e63-44b1-83c8-20070ff0450b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:36.875101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1207/2428] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:09:36 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:09:36.885829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e7ef-a3c9-4aa1-8812-779d1f23b3bf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:36.886756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e7ef-a3c9-4aa1-8812-779d1f23b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:36.887322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4e7ef-a3c9-4aa1-8812-779d1f23b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:36.914453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8bc4e7ef-a3c9-4aa1-8812-779d1f23b3bf None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:36.915691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8bc4e7ef-a3c9-4aa1-8812-779d1f23b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:36.929127 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1222/2429] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:09:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:36.945104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e5f9-0e63-44b1-83c8-20070ff0450b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:36.947385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19a6e5f9-0e63-44b1-83c8-20070ff0450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:37.027755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e5f9-0e63-44b1-83c8-20070ff0450b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:37.037974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10fc06-8d6b-4628-8a46-1fe4e5a7fc16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:37.042177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10fc06-8d6b-4628-8a46-1fe4e5a7fc16 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.042866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10fc06-8d6b-4628-8a46-1fe4e5a7fc16 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.043770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10fc06-8d6b-4628-8a46-1fe4e5a7fc16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.070640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10fc06-8d6b-4628-8a46-1fe4e5a7fc16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:37.072053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10fc06-8d6b-4628-8a46-1fe4e5a7fc16 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:37.087302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1208/2430] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:37.247240 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9024-bc3f-4509-b03f-f65b3a55d508 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.247893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9024-bc3f-4509-b03f-f65b3a55d508 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.248554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9024-bc3f-4509-b03f-f65b3a55d508 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.250908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1223/2431] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:09:37 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 01 17:09:37.260817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f46ec-d6cb-4e7d-a8af-aba17c893871 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.261084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f46ec-d6cb-4e7d-a8af-aba17c893871 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.261305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f46ec-d6cb-4e7d-a8af-aba17c893871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.308930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bd7f46ec-d6cb-4e7d-a8af-aba17c893871 None None] MFA Rules not processed for user `112c65065f6d4c5990f3952e0099cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:37.308930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bd7f46ec-d6cb-4e7d-a8af-aba17c893871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:37.313986 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1209/2432] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:09:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:37.329869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9024-bc3f-4509-b03f-f65b3a55d508 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:37.346304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9024-bc3f-4509-b03f-f65b3a55d508 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:37.355758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bf17-9710-4df2-982b-e24e42b4c61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:37.357513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bf17-9710-4df2-982b-e24e42b4c61c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.358371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bf17-9710-4df2-982b-e24e42b4c61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.359043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bf17-9710-4df2-982b-e24e42b4c61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.379202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bf17-9710-4df2-982b-e24e42b4c61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:37.383039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bf17-9710-4df2-982b-e24e42b4c61c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:37.401328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1224/2433] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:37.524119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8cd5-b405-49bc-99a8-e8fbf50e3179 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.524411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8cd5-b405-49bc-99a8-e8fbf50e3179 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.524694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8cd5-b405-49bc-99a8-e8fbf50e3179 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.526064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1210/2434] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 1 17:09:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 01 17:09:37.532178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.532661 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.533084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.554240 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] MFA Rules not processed for user `fa3215124493472d89807ab5845258fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:37.555480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:37.567901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1225/2435] 10.222.0.121 () {58 vars in 1023 bytes} [Mon Aug 1 17:09:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:37.581358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8cd5-b405-49bc-99a8-e8fbf50e3179 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:37.593570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8cd5-b405-49bc-99a8-e8fbf50e3179 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:37.597843 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07113836-5d8e-48e5-918e-587bb9503c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:37.598520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113836-5d8e-48e5-918e-587bb9503c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.599037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113836-5d8e-48e5-918e-587bb9503c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.599407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113836-5d8e-48e5-918e-587bb9503c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.613764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07113836-5d8e-48e5-918e-587bb9503c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:37.616201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07113836-5d8e-48e5-918e-587bb9503c33 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:37.630913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1211/2436] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:37.709345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:37.709345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:37.805563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbb06d-db29-41c5-a104-4068880e3173 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:37.811754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:37.812121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:37.812405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:37.812680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:37.814601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:37.828398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:37.830918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:37.849589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1226/2437] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:09:40.260315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:40.261135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:40.261312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:40.286677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:40.287921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:40.324237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:40.378314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1212/2438] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:40.395481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:40.397758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:40.517223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fc0cb-62cc-4e9b-a768-e0c9ac8be116 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:40.523766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:40.524420 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:40.524708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:40.524991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:40.535265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:40.537179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:40.546352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1227/2439] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:09:41.399443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:41.401860 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:41.427831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f574ff2-b67a-41a3-ae90-57a11c665c20 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:41.434677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe623d2-885e-45a3-b4e0-d958a939cf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:41.435758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe623d2-885e-45a3-b4e0-d958a939cf95 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:41.436265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe623d2-885e-45a3-b4e0-d958a939cf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:41.436702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe623d2-885e-45a3-b4e0-d958a939cf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:41.439335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bbe623d2-885e-45a3-b4e0-d958a939cf95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:41.551617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe623d2-885e-45a3-b4e0-d958a939cf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:41.553945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe623d2-885e-45a3-b4e0-d958a939cf95 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:41.568069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1213/2440] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:43.382935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:43.411677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf41ce-734f-4d2c-9c6f-892c35ab3021 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:43.432705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:43.433504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:43.433783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:43.434066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] PATH_INFO: `/v3/users/2c72e86fa24945eb950a192371eab08a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:43.437356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c72e86fa24945eb950a192371eab08a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:43.439463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:43.549877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:43.575460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c72e86fa24945eb950a192371eab08a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:43.605411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c72e86fa24945eb950a192371eab08a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:43.666518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c72e86fa24945eb950a192371eab08a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:43.669783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c72e86fa24945eb950a192371eab08a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:43.674113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c72e86fa24945eb950a192371eab08a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:43.711910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1228/2441] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:43 2022] DELETE /identity/v3/users/2c72e86fa24945eb950a192371eab08a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:43.716786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:43.717940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:43.717940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:43.763953 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:43.766382 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:43.888411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1214/2442] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:43.906585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:43.908242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:44.010512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58c589-d51f-424f-b8a4-36c3cfec44d6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:44.016756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171e5e9-960c-4ec1-8c57-a86e4074cd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:44.017432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171e5e9-960c-4ec1-8c57-a86e4074cd79 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:44.017867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171e5e9-960c-4ec1-8c57-a86e4074cd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:44.018160 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171e5e9-960c-4ec1-8c57-a86e4074cd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:44.033706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171e5e9-960c-4ec1-8c57-a86e4074cd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:44.033706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171e5e9-960c-4ec1-8c57-a86e4074cd79 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:44.067385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1229/2443] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:44.765057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:44.766968 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:44.805255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207093-3ed3-4904-a392-e7a3c8af732a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:44.822747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:44.823580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:44.825494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:44.830050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] PATH_INFO: `/v3/projects/47b9bc87ec5d45119eff4d4c6c7340e9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:44.832318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b9bc87ec5d45119eff4d4c6c7340e9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:44.837851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:44.960978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b9bc87ec5d45119eff4d4c6c7340e9', 'request_id': 'req-1c6e10d9-c074-4ef3-945a-12314dd2fece'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:44.973852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b9bc87ec5d45119eff4d4c6c7340e9', 'request_id': 'req-1c6e10d9-c074-4ef3-945a-12314dd2fece'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:44.994001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b9bc87ec5d45119eff4d4c6c7340e9', 'request_id': 'req-1c6e10d9-c074-4ef3-945a-12314dd2fece'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:44.995870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:45.026763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] The token cache is being invalidate because project 47b9bc87ec5d45119eff4d4c6c7340e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:45.027064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:45.031471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c6e10d9-c074-4ef3-945a-12314dd2fece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:45.041074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1215/2444] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:44 2022] DELETE /identity/v3/projects/47b9bc87ec5d45119eff4d4c6c7340e9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:45.047180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caef4f-8577-4529-9ca4-2070cf6c6b24 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.047759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caef4f-8577-4529-9ca4-2070cf6c6b24 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.047759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caef4f-8577-4529-9ca4-2070cf6c6b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.094724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d3caef4f-8577-4529-9ca4-2070cf6c6b24 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:45.096517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d3caef4f-8577-4529-9ca4-2070cf6c6b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:45.260190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1230/2445] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:45.371307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f465-5480-4369-a261-af86f3887803 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.371307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f465-5480-4369-a261-af86f3887803 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.371548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f465-5480-4369-a261-af86f3887803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.404927 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9bf2f465-5480-4369-a261-af86f3887803 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:45.407815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9bf2f465-5480-4369-a261-af86f3887803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:45.424331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1216/2446] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:45.428654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caef4f-8577-4529-9ca4-2070cf6c6b24 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:45.443372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caef4f-8577-4529-9ca4-2070cf6c6b24 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:45.449155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:45.450082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.450642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.450942 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.452306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:45.452838 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:45.454758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:45.480583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f465-5480-4369-a261-af86f3887803 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:45.493191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1231/2447] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:09:45.496189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f465-5480-4369-a261-af86f3887803 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:45.505969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:45.506936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.507204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.507537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.508282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:45.510813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:45.568170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1217/2448] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:45 2022] POST /identity/v3/projects => generated 398 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:45.572632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:45.586616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df40b20-dfc4-4b99-8db0-cae6b13f8390 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:45.661283 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:45.684089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:45.684968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.685262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.685710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.687721 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:45.690664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:45.737389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:45.738025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1232/2449] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:45 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:45.752318 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a754b-c554-4cdd-97a4-54220535ad98 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:45.757429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:45.758206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.758603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.759004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.759807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:45.761541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:45.773961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1218/2450] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:45 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:45.778219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:45.791554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea862a77-7ff4-4a5a-a8e5-17ad9af95dfd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:45.809787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf5c8-52e3-4e10-a326-6b62025746ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:45.811670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf5c8-52e3-4e10-a326-6b62025746ff admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.812298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf5c8-52e3-4e10-a326-6b62025746ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.814136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf5c8-52e3-4e10-a326-6b62025746ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.816249 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acf5c8-52e3-4e10-a326-6b62025746ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:45.823791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acf5c8-52e3-4e10-a326-6b62025746ff admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:45.858397 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1233/2451] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:45 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:45.862438 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:45.874353 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc7b54-a1f1-4f2f-b599-6238c9ea4296 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:45.880271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:45.895743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.896245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.896707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] PATH_INFO: `/v3/projects/90aa0071f3f44628ae9c2d47ed441c4d/users/57ff117297194c5fba501c3e8523354f/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:45.931617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90aa0071f3f44628ae9c2d47ed441c4d, user_id=57ff117297194c5fba501c3e8523354f, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:45.935080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:45.957791 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1219/2452] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:45 2022] PUT /identity/v3/projects/90aa0071f3f44628ae9c2d47ed441c4d/users/57ff117297194c5fba501c3e8523354f/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:45.969744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:45.970044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:45.970359 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:46.024186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] MFA Rules not processed for user `57ff117297194c5fba501c3e8523354f`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:46.026647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:46.153917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1234/2453] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:46.167265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:46.171061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:46.261224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff16e2-c1df-4007-936e-580b570e705c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:46.266100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:46.267040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:46.267333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:46.267613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:46.281228 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:46.282770 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:46.317234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1220/2454] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:47.321308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:47.323842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:47.485493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8b544-c408-4994-b1fa-fd7f6dcf0686 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:47.491396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:47.492352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:47.492644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:47.492923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] PATH_INFO: `/v3/users/b125e48efd9c4907be550b3f4077134c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:47.494271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b125e48efd9c4907be550b3f4077134c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:47.496262 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:47.579857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b125e48efd9c4907be550b3f4077134c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:47.589076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b125e48efd9c4907be550b3f4077134c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:47.590941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:47.611285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b125e48efd9c4907be550b3f4077134c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:47.612374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b125e48efd9c4907be550b3f4077134c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:47.613224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-156466f5-bd03-4182-aec9-3f08b5f4d8d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b125e48efd9c4907be550b3f4077134c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:47.632422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1235/2455] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:47 2022] DELETE /identity/v3/users/b125e48efd9c4907be550b3f4077134c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:47.903253 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:47.950324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd954b7a-f657-4713-ba45-424eeaed022d service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.062231 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.063297 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.063621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.063929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] PATH_INFO: `/v3/projects/6e61adb9cb4948cd95dbbc6b707a6bd4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.065162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e61adb9cb4948cd95dbbc6b707a6bd4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.067215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.104871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:48.134808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e61adb9cb4948cd95dbbc6b707a6bd4', 'request_id': 'req-b48896ce-c652-42f1-8024-e06d843852e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:48.145522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e61adb9cb4948cd95dbbc6b707a6bd4', 'request_id': 'req-b48896ce-c652-42f1-8024-e06d843852e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:48.155294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e61adb9cb4948cd95dbbc6b707a6bd4', 'request_id': 'req-b48896ce-c652-42f1-8024-e06d843852e3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:48.169187 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] The token cache is being invalidate because project 6e61adb9cb4948cd95dbbc6b707a6bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:48.169772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:48.171046 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b48896ce-c652-42f1-8024-e06d843852e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:48.173413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1221/2456] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:47 2022] DELETE /identity/v3/projects/6e61adb9cb4948cd95dbbc6b707a6bd4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:48.178551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bee7-a5a3-438a-9be1-dc21fa3a6d28 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.178551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bee7-a5a3-438a-9be1-dc21fa3a6d28 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.178822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bee7-a5a3-438a-9be1-dc21fa3a6d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.207221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-66b8bee7-a5a3-438a-9be1-dc21fa3a6d28 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:48.208487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-66b8bee7-a5a3-438a-9be1-dc21fa3a6d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:48.302997 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1236/2457] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:48.313182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d5a8-37d0-4240-b245-fbb767fd9ce9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.314080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d5a8-37d0-4240-b245-fbb767fd9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.314080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d5a8-37d0-4240-b245-fbb767fd9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.336363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c055d5a8-37d0-4240-b245-fbb767fd9ce9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:48.336680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c055d5a8-37d0-4240-b245-fbb767fd9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:48.347650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1222/2458] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:48.351912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8bee7-a5a3-438a-9be1-dc21fa3a6d28 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:48.362710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8bee7-a5a3-438a-9be1-dc21fa3a6d28 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.367763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.368391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.368677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.368956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.369690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:48.369995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.371695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.384301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1237/2459] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:09:48.388755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d5a8-37d0-4240-b245-fbb767fd9ce9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:48.399366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d5a8-37d0-4240-b245-fbb767fd9ce9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.404677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.405300 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.405585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.405861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.407338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.409361 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.443480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1223/2460] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:48 2022] POST /identity/v3/projects => generated 374 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:48.447445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:48.463037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae52a54-5bc5-426a-876b-c3372b4602ab admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.521636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.522646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.522933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.523216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.523890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.525834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.550762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1238/2461] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:48 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:48.555085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:48.568120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293bb70-b2d5-4c7c-b7e2-5d59e88a3c80 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.574950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.575687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.576012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.576419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.577285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.578993 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.590199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1224/2462] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:48 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:48.595001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:48.605398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3783c6-4fb9-49d3-92c9-e7e10b1d2615 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.611621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760b623-0df2-49fe-930b-3ab4e7152234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.612306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760b623-0df2-49fe-930b-3ab4e7152234 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.612624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760b623-0df2-49fe-930b-3ab4e7152234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.613730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760b623-0df2-49fe-930b-3ab4e7152234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.617412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760b623-0df2-49fe-930b-3ab4e7152234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.619444 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760b623-0df2-49fe-930b-3ab4e7152234 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.634094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1239/2463] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:48 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:48.638914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:48.649294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562adc9-3f41-4aa9-a4a3-cb663eb03999 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.654008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.655287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.655576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.655858 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] PATH_INFO: `/v3/projects/30cffa6a43dc4b85b4f802e175bc8737/users/f3260852fa844dce9fc158a0bf150c30/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.671511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cffa6a43dc4b85b4f802e175bc8737, user_id=f3260852fa844dce9fc158a0bf150c30, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.674234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.687171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1225/2464] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:48 2022] PUT /identity/v3/projects/30cffa6a43dc4b85b4f802e175bc8737/users/f3260852fa844dce9fc158a0bf150c30/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:48.697602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ed13-d13a-4880-865b-9793ee3c72e7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.697894 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ed13-d13a-4880-865b-9793ee3c72e7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.698178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ed13-d13a-4880-865b-9793ee3c72e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.726186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6e87ed13-d13a-4880-865b-9793ee3c72e7 None None] MFA Rules not processed for user `f3260852fa844dce9fc158a0bf150c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:48.727438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6e87ed13-d13a-4880-865b-9793ee3c72e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:48.757728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:48.797082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1240/2465] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:48.808655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:48.810455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:48.887037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9affef-10ac-4c7c-85e9-d048169ee597 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:48.893602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe2a94-37e8-4112-9872-2c772305d60a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:48.894320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe2a94-37e8-4112-9872-2c772305d60a service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:48.894714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe2a94-37e8-4112-9872-2c772305d60a service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:48.895109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe2a94-37e8-4112-9872-2c772305d60a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:48.905001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe2a94-37e8-4112-9872-2c772305d60a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:48.906705 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe2a94-37e8-4112-9872-2c772305d60a service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:48.916207 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1226/2466] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:49.137374 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87ed13-d13a-4880-865b-9793ee3c72e7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:49.205393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87ed13-d13a-4880-865b-9793ee3c72e7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:49.210126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:49.210840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:49.211129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:49.211405 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] PATH_INFO: `/v3/users/f3260852fa844dce9fc158a0bf150c30` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:49.212622 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3260852fa844dce9fc158a0bf150c30)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:49.214678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:49.266503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3260852fa844dce9fc158a0bf150c30'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:49.281974 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3260852fa844dce9fc158a0bf150c30'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:49.303254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3260852fa844dce9fc158a0bf150c30'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:49.304084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3260852fa844dce9fc158a0bf150c30'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:49.304775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3260852fa844dce9fc158a0bf150c30'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:49.323593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1241/2467] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:49 2022] DELETE /identity/v3/users/f3260852fa844dce9fc158a0bf150c30 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:49.328837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:49.329135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:49.330530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:49.350105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:49.352021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:49.404677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:49.438079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1227/2468] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:49.449784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:49.453039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:49.527109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:49.532919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af56dc-baf4-447c-b483-9fc07845dfcb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:49.539720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a960574-59c9-4cbe-8fa6-7ee659374f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:49.540853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960574-59c9-4cbe-8fa6-7ee659374f5a service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:49.541820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960574-59c9-4cbe-8fa6-7ee659374f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:49.542307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a960574-59c9-4cbe-8fa6-7ee659374f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:49.557173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a960574-59c9-4cbe-8fa6-7ee659374f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:49.559126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a960574-59c9-4cbe-8fa6-7ee659374f5a service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:49.572730 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1242/2469] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:49.896643 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:49.898491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:49.916702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e81de-321a-4687-841b-a5e4b2fa3d14 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:49.924026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:49.924647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:49.924932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:49.925584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] PATH_INFO: `/v3/projects/30cffa6a43dc4b85b4f802e175bc8737` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:49.927034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cffa6a43dc4b85b4f802e175bc8737)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:49.929107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:49.987533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cffa6a43dc4b85b4f802e175bc8737', 'request_id': 'req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:49.994970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cffa6a43dc4b85b4f802e175bc8737', 'request_id': 'req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:50.003281 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cffa6a43dc4b85b4f802e175bc8737', 'request_id': 'req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:50.017109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] The token cache is being invalidate because project 30cffa6a43dc4b85b4f802e175bc8737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:50.017443 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:50.018189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2d31c837-c392-4dcf-a4ea-c0fdf63e971e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:50.019808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1228/2470] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:49 2022] DELETE /identity/v3/projects/30cffa6a43dc4b85b4f802e175bc8737 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:50.025215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516966-7947-4b24-882f-cfdc855b0d7f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.025494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516966-7947-4b24-882f-cfdc855b0d7f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.025785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99516966-7947-4b24-882f-cfdc855b0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.048837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-99516966-7947-4b24-882f-cfdc855b0d7f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:50.050087 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-99516966-7947-4b24-882f-cfdc855b0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:50.118617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1243/2471] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:50.128077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf54b9-6f9e-4419-b0d0-ed4f98fce1b5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.128400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf54b9-6f9e-4419-b0d0-ed4f98fce1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.128689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf54b9-6f9e-4419-b0d0-ed4f98fce1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.149797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9daf54b9-6f9e-4419-b0d0-ed4f98fce1b5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:50.151054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9daf54b9-6f9e-4419-b0d0-ed4f98fce1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:50.159160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1229/2472] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:50.163635 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516966-7947-4b24-882f-cfdc855b0d7f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.174127 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99516966-7947-4b24-882f-cfdc855b0d7f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.178816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.179432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.179719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.180024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.180746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:09:50.181050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.182692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.195461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1244/2473] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:09:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:09:50.199909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf54b9-6f9e-4419-b0d0-ed4f98fce1b5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.210661 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf54b9-6f9e-4419-b0d0-ed4f98fce1b5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.215579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.216213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.216501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.216783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.217460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.219425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.247330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1230/2474] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:50 2022] POST /identity/v3/projects => generated 382 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:09:50.252367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.262625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dbd4a-8b1b-425f-8539-8ef9d004b604 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.319529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.320153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.320433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.320707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.321378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.323358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.349907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1245/2475] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:50 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:50.351179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.361708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d55512-f06d-4dbe-82bd-dc1507dff251 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.366586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.367064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.367344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.367617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.368319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.369911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.381255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1231/2476] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:50 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:50.385416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.396927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a222e-10da-4af1-9e0a-3b047f86369e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.402138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ff57c-9263-44cd-a41e-6a8779a1f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.402806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ff57c-9263-44cd-a41e-6a8779a1f8af admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.403312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ff57c-9263-44cd-a41e-6a8779a1f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.403591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ff57c-9263-44cd-a41e-6a8779a1f8af admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.404290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ff57c-9263-44cd-a41e-6a8779a1f8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.405919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ff57c-9263-44cd-a41e-6a8779a1f8af admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.417068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1246/2477] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:50 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:09:50.422011 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.432345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212f9cf-ebd5-43ad-a715-fab722f2f779 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.437777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.438596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.438992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.439278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] PATH_INFO: `/v3/projects/ceb39edf2f7a47bf9f41af9f3357183d/users/04be1edd062240729b6e8634fdb60f59/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.454309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb39edf2f7a47bf9f41af9f3357183d, user_id=04be1edd062240729b6e8634fdb60f59, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.457007 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.470998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1232/2478] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:50 2022] PUT /identity/v3/projects/ceb39edf2f7a47bf9f41af9f3357183d/users/04be1edd062240729b6e8634fdb60f59/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:09:50.484708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a61b-e6c0-4703-9f11-8e07ba9e7c68 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.485269 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a61b-e6c0-4703-9f11-8e07ba9e7c68 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.485431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2a61b-e6c0-4703-9f11-8e07ba9e7c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.516086 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5cf2a61b-e6c0-4703-9f11-8e07ba9e7c68 None None] MFA Rules not processed for user `04be1edd062240729b6e8634fdb60f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:50.517244 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5cf2a61b-e6c0-4703-9f11-8e07ba9e7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:50.565291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:50.585830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1247/2479] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:50.590340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.655783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0642f-367f-43ca-8c37-d711acb2487c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.661585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.662220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.662531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.662812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.663495 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.665417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.670742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:50.703883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1233/2480] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:09:50 2022] POST /identity/v3/projects => generated 380 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:50.716878 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a61b-e6c0-4703-9f11-8e07ba9e7c68 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.743975 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2a61b-e6c0-4703-9f11-8e07ba9e7c68 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.822223 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.822805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.823256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.823589 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.824265 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.826352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.849602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1248/2481] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:09:50 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:09:50.853784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.867946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1f489-cdf9-421e-b12d-f86afe4776ca admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.873869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.874704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.875055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.875408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.876392 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.886547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.898525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1234/2482] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:50 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:50.902939 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.914798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809533f-cbd2-4dfc-8917-9c10cb730025 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:50.921296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:50.922217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:50.922707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:50.922919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] PATH_INFO: `/v3/projects/4b1bdc209000408285caeea4e4343ca2/users/91074344f0e64b6cb4e0c9142f979e3f/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:50.939631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1bdc209000408285caeea4e4343ca2, user_id=91074344f0e64b6cb4e0c9142f979e3f, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:50.943523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:50.960588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1249/2483] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:50 2022] PUT /identity/v3/projects/4b1bdc209000408285caeea4e4343ca2/users/91074344f0e64b6cb4e0c9142f979e3f/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:50.964868 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:50.976831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79715b6a-5a75-4655-9a4a-ed62b66f89ad admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:51.046002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcbcbb-46e5-4c23-8f90-1fa144740c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:51.046885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbcbb-46e5-4c23-8f90-1fa144740c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:51.047257 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbcbb-46e5-4c23-8f90-1fa144740c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:51.047667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcbcbb-46e5-4c23-8f90-1fa144740c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:51.048460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbcbb-46e5-4c23-8f90-1fa144740c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:51.051036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcbcbb-46e5-4c23-8f90-1fa144740c08 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:51.065408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1235/2484] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:09:50 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:09:51.069911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:51.081090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55eead-dc3e-4efa-91e1-52a1d1bb1970 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:51.085749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:51.086232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:51.086541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:51.086811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] PATH_INFO: `/v3/projects/4b1bdc209000408285caeea4e4343ca2/users/91074344f0e64b6cb4e0c9142f979e3f/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:51.088789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1bdc209000408285caeea4e4343ca2, user_id=91074344f0e64b6cb4e0c9142f979e3f, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:51.091499 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:51.103590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1250/2485] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:09:51 2022] PUT /identity/v3/projects/4b1bdc209000408285caeea4e4343ca2/users/91074344f0e64b6cb4e0c9142f979e3f/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:51.117800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0638c-a839-4edc-946c-273ac4bfc522 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:51.118352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0638c-a839-4edc-946c-273ac4bfc522 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:51.118967 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0638c-a839-4edc-946c-273ac4bfc522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:51.148981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-beb0638c-a839-4edc-946c-273ac4bfc522 None None] MFA Rules not processed for user `91074344f0e64b6cb4e0c9142f979e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:51.150214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-beb0638c-a839-4edc-946c-273ac4bfc522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:51.222659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1236/2486] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:51.234317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:51.236168 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:51.298350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d773-3bbb-4f95-934a-38ba7656295e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:51.302797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:51.303423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:51.303705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:51.303982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:51.314505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:51.316099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:51.328994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1251/2487] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:51.413588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0638c-a839-4edc-946c-273ac4bfc522 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:51.423646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0638c-a839-4edc-946c-273ac4bfc522 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:51.427505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479380a1-aae5-4b89-8bc8-75b38e5a6f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:51.428128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479380a1-aae5-4b89-8bc8-75b38e5a6f3e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:51.428414 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479380a1-aae5-4b89-8bc8-75b38e5a6f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:51.428690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479380a1-aae5-4b89-8bc8-75b38e5a6f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:51.483466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:51.490111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479380a1-aae5-4b89-8bc8-75b38e5a6f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:51.491836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479380a1-aae5-4b89-8bc8-75b38e5a6f3e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:51.502766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1237/2488] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:51.922171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:51.923782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:51.975718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:51.995928 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d273fc-038c-4abd-a5da-b153839d9ef2 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:52.001151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:52.001801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:52.002089 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:52.002404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] PATH_INFO: `/v3/users/57ff117297194c5fba501c3e8523354f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:52.003596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ff117297194c5fba501c3e8523354f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:52.005528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:52.054693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ff117297194c5fba501c3e8523354f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.062383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ff117297194c5fba501c3e8523354f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.075487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ff117297194c5fba501c3e8523354f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.076243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ff117297194c5fba501c3e8523354f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.076863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ff117297194c5fba501c3e8523354f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.090697 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1252/2489] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:51 2022] DELETE /identity/v3/users/57ff117297194c5fba501c3e8523354f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:52.095456 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:52.095940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:52.096077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:52.127607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:52.129081 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:52.193735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1238/2490] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:52.204272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:52.205748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:52.276880 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d31493-7648-40af-9ff5-515d5efc8900 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:52.280728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb39d1-02cf-4049-9121-01526f94ebb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:52.281481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb39d1-02cf-4049-9121-01526f94ebb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:52.281798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb39d1-02cf-4049-9121-01526f94ebb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:52.282098 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb39d1-02cf-4049-9121-01526f94ebb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:52.292958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb39d1-02cf-4049-9121-01526f94ebb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:52.294479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb39d1-02cf-4049-9121-01526f94ebb1 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:52.306034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1253/2491] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:52.606930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:52.609041 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:52.629822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25760e8a-bdb4-445f-adaf-2f8f69934aa1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:52.635620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:52.636630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:52.637006 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:52.637378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] PATH_INFO: `/v3/projects/90aa0071f3f44628ae9c2d47ed441c4d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:52.638683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90aa0071f3f44628ae9c2d47ed441c4d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:52.640614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:52.689528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90aa0071f3f44628ae9c2d47ed441c4d', 'request_id': 'req-881680df-5c69-4ed7-9539-9ed078ff8b47'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.697875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90aa0071f3f44628ae9c2d47ed441c4d', 'request_id': 'req-881680df-5c69-4ed7-9539-9ed078ff8b47'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.709801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90aa0071f3f44628ae9c2d47ed441c4d', 'request_id': 'req-881680df-5c69-4ed7-9539-9ed078ff8b47'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.722797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] The token cache is being invalidate because project 90aa0071f3f44628ae9c2d47ed441c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:52.723087 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.723916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:52.726016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1239/2492] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:52 2022] DELETE /identity/v3/projects/90aa0071f3f44628ae9c2d47ed441c4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:56.733933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:56.734474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:56.734689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:56.755553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:56.756898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:56.817279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1254/2493] 10.222.0.121 () {58 vars in 972 bytes} [Mon Aug 1 17:09:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:09:56.835827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:56.837976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:56.916640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881680df-5c69-4ed7-9539-9ed078ff8b47 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:56.922454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2fba8-b312-4fd6-9b48-55e94940abbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:56.924282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fba8-b312-4fd6-9b48-55e94940abbf service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:56.924282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fba8-b312-4fd6-9b48-55e94940abbf service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:56.924282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2fba8-b312-4fd6-9b48-55e94940abbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:56.933599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2fba8-b312-4fd6-9b48-55e94940abbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:56.935372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2fba8-b312-4fd6-9b48-55e94940abbf service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:56.944111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1240/2494] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:09:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:09:58.825469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:58.828115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:58.850117 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:58.928309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0245-d365-4120-8c2c-8e70ed953318 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:58.933512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:58.934190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:58.934516 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:58.934793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] PATH_INFO: `/v3/users/04be1edd062240729b6e8634fdb60f59` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:58.936077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04be1edd062240729b6e8634fdb60f59)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:58.938025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:58.992903 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04be1edd062240729b6e8634fdb60f59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.000648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04be1edd062240729b6e8634fdb60f59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.016052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04be1edd062240729b6e8634fdb60f59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.016829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04be1edd062240729b6e8634fdb60f59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.017452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04be1edd062240729b6e8634fdb60f59'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.033480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1255/2495] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:58 2022] DELETE /identity/v3/users/04be1edd062240729b6e8634fdb60f59 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:59.038116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:59.038945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:59.038945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:59.059916 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:59.069135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:09:59.070777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:59.142613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1241/2496] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:09:59.156337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:59.158626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:59.258004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cced9-26c8-4f4f-b9da-0d8d711b912a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:59.261864 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:59.264039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:59.264039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:59.264039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:59.274644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:59.276196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:59.289793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1256/2497] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:09:59.659612 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:59.661075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:09:59.674891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a528f-b060-4206-a858-4a3fe0271820 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:59.680616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:59.681094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:59.681452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:59.681848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] PATH_INFO: `/v3/projects/ceb39edf2f7a47bf9f41af9f3357183d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:59.683298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb39edf2f7a47bf9f41af9f3357183d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:59.685943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:59.740134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb39edf2f7a47bf9f41af9f3357183d', 'request_id': 'req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.749000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb39edf2f7a47bf9f41af9f3357183d', 'request_id': 'req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.757140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb39edf2f7a47bf9f41af9f3357183d', 'request_id': 'req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.769526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] The token cache is being invalidate because project ceb39edf2f7a47bf9f41af9f3357183d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:09:59.769814 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.770481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.772296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1242/2498] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:09:59 2022] DELETE /identity/v3/projects/ceb39edf2f7a47bf9f41af9f3357183d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:09:59.776256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:09:59.786836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73304-f40e-4cac-bc57-4b436a4be846 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:09:59.816443 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:09:59.848973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:09:59.849702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:09:59.850039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:09:59.850547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] PATH_INFO: `/v3/users/91074344f0e64b6cb4e0c9142f979e3f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:09:59.852006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91074344f0e64b6cb4e0c9142f979e3f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:09:59.854170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:09:59.911029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91074344f0e64b6cb4e0c9142f979e3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.918224 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91074344f0e64b6cb4e0c9142f979e3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.931024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91074344f0e64b6cb4e0c9142f979e3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.931763 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91074344f0e64b6cb4e0c9142f979e3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.932427 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea38f98c-9f88-4b4c-bb9c-d2aeed7c16f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91074344f0e64b6cb4e0c9142f979e3f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:09:59.945178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1257/2499] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:09:59 2022] DELETE /identity/v3/users/91074344f0e64b6cb4e0c9142f979e3f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:00.242313 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:00.244249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:00.261255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb9c64-2d1a-4196-80a7-1ae14ba052c8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:00.321566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:00.322243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.322552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.322824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] PATH_INFO: `/v3/projects/4b1bdc209000408285caeea4e4343ca2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.323977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1bdc209000408285caeea4e4343ca2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:00.326078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:00.366666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:00.387033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1bdc209000408285caeea4e4343ca2', 'request_id': 'req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:00.393192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1bdc209000408285caeea4e4343ca2', 'request_id': 'req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:00.400961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1bdc209000408285caeea4e4343ca2', 'request_id': 'req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:00.412402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] The token cache is being invalidate because project 4b1bdc209000408285caeea4e4343ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:00.412853 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:00.413573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e9b41b52-5268-4a2c-8939-76f0ae66e8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:00.415226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1243/2500] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:00 2022] DELETE /identity/v3/projects/4b1bdc209000408285caeea4e4343ca2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:00.420952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1605d7-e164-4b74-87db-a634c30f558e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.421239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1605d7-e164-4b74-87db-a634c30f558e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.421522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1605d7-e164-4b74-87db-a634c30f558e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.442169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1a1605d7-e164-4b74-87db-a634c30f558e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:00.443330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1a1605d7-e164-4b74-87db-a634c30f558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:00.508206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1258/2501] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:00.517418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7df72e-56ca-4aca-8152-6d273377b140 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.517702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7df72e-56ca-4aca-8152-6d273377b140 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.517976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7df72e-56ca-4aca-8152-6d273377b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.537874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8c7df72e-56ca-4aca-8152-6d273377b140 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:00.539101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8c7df72e-56ca-4aca-8152-6d273377b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:00.547496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1244/2502] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:00.551873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1605d7-e164-4b74-87db-a634c30f558e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:00.563338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1605d7-e164-4b74-87db-a634c30f558e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:00.568010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:00.568636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.568922 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.569200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.569899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:00.570484 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:00.571887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:00.585215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1259/2503] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:10:00.589890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7df72e-56ca-4aca-8152-6d273377b140 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:00.600432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7df72e-56ca-4aca-8152-6d273377b140 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:00.605122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:00.605742 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.606021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.606327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.607031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:00.609523 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:00.648241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1245/2504] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:00 2022] POST /identity/v3/projects => generated 364 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:00.649756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:00.661615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf814-c25d-48c5-861a-28bf8d9419ac admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:00.701690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:00.729606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:00.730365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.730797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.731046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.731839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:00.734517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:00.761307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1260/2505] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:00 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:00.762700 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:00.773924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeed04-6246-4cd1-99a6-3388e1d63d49 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:00.779405 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:00.779859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.780145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.780420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.781119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:00.783288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:00.793803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1246/2506] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:00 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:00.799021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:00.810011 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4169f-f4ce-45f3-809d-6224334e3de8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:00.816462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019122d0-e477-4b23-9958-9debbcde5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:00.817366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019122d0-e477-4b23-9958-9debbcde5f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.817748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019122d0-e477-4b23-9958-9debbcde5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.818182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019122d0-e477-4b23-9958-9debbcde5f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.818971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019122d0-e477-4b23-9958-9debbcde5f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:00.820684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019122d0-e477-4b23-9958-9debbcde5f35 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:00.832948 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1261/2507] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:00 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:00.837274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:00.848336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61178c4-2c57-4cc4-98fd-33df522aafae admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:00.853682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:00.854417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.854707 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.854980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] PATH_INFO: `/v3/projects/c18ddb46ea1343ecaeddd1243c7ce3a1/users/87a058e462f740ccabea561ac09e7c6b/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.870550 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18ddb46ea1343ecaeddd1243c7ce3a1, user_id=87a058e462f740ccabea561ac09e7c6b, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:00.873305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:00.885914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1247/2508] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:00 2022] PUT /identity/v3/projects/c18ddb46ea1343ecaeddd1243c7ce3a1/users/87a058e462f740ccabea561ac09e7c6b/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:00.896382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f96-fc12-48c8-bf84-2d219325ef30 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:00.897183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f96-fc12-48c8-bf84-2d219325ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:00.897183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f96-fc12-48c8-bf84-2d219325ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:00.930085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-668a7f96-fc12-48c8-bf84-2d219325ef30 None None] MFA Rules not processed for user `87a058e462f740ccabea561ac09e7c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:00.931570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-668a7f96-fc12-48c8-bf84-2d219325ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:00.998595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1262/2509] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:01.003265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.068116 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c246b7-9774-45f3-9214-c16e89f1a4c4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.072812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.073427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.073708 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.073985 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.074674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.077102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.104560 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1248/2510] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:01 2022] POST /identity/v3/projects => generated 364 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:01.108798 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a7f96-fc12-48c8-bf84-2d219325ef30 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.120019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a7f96-fc12-48c8-bf84-2d219325ef30 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.181042 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.181656 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.181935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.182215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.182907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.184886 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.208571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1263/2511] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:01 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:01.213442 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.224762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9179ea9-f811-494d-997c-1d3c6f9c59af admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.229451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.230108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.230431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.230712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.231406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.233058 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.246780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1249/2512] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:01 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:01.251151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.261522 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e352010-645e-4d59-84f7-7451700f835d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.266892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.267557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.267839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.268121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] PATH_INFO: `/v3/projects/c98f54c20c6443e39bd78d8a260211a7/users/4fb27d3009f940e5a91993dbcffd2fe9/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.284217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98f54c20c6443e39bd78d8a260211a7, user_id=4fb27d3009f940e5a91993dbcffd2fe9, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.286999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.300142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1264/2513] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:01 2022] PUT /identity/v3/projects/c98f54c20c6443e39bd78d8a260211a7/users/4fb27d3009f940e5a91993dbcffd2fe9/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:01.304177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.314859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61285e-93cd-4f1f-8a87-7287fb7a8df0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.343982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:01.374572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb20b6-a670-44de-8602-0de1e30765a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.375198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb20b6-a670-44de-8602-0de1e30765a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.375565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb20b6-a670-44de-8602-0de1e30765a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.376169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb20b6-a670-44de-8602-0de1e30765a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.376434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb20b6-a670-44de-8602-0de1e30765a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.378026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb20b6-a670-44de-8602-0de1e30765a7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.387923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1250/2514] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:01 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:01.392751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.403648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db58bb-31bd-4d00-a699-1bdcf4e08105 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.408480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.409144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.409436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.409720 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] PATH_INFO: `/v3/projects/c98f54c20c6443e39bd78d8a260211a7/users/4fb27d3009f940e5a91993dbcffd2fe9/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.411785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98f54c20c6443e39bd78d8a260211a7, user_id=4fb27d3009f940e5a91993dbcffd2fe9, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.414549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.420576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:01.426696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1265/2515] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:01 2022] PUT /identity/v3/projects/c98f54c20c6443e39bd78d8a260211a7/users/4fb27d3009f940e5a91993dbcffd2fe9/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:01.438038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.438372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.438667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.467654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] MFA Rules not processed for user `4fb27d3009f940e5a91993dbcffd2fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:01.468886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:01.536491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1251/2516] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:01.547664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.549427 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:01.608337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32500cf0-556d-4ec7-9282-152eab71719d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.612053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.612704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.612984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.613258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.623311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.625145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.635041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1266/2517] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:01.714956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:01.720327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:01.729565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106aa9e-ae9b-4b81-89ff-5976e6516565 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:01.734636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:01.735271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:01.735555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:01.735835 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:01.798923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:01.799122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:01.809100 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1252/2518] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:03.058756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:03.060289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:03.128075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d98e6-a43f-41e0-95b5-be6659a69142 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:03.132375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:03.133031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:03.133315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:03.133596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:03.135464 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:03.206339 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:03.207869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:03.219272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1267/2519] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:06.836546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:06.839061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:06.855942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04006020-1352-48c0-b1ca-fa6f6cec7aa5 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:06.863944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:06.865030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:06.865524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:06.866038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] PATH_INFO: `/v3/users/e6779c1c95ee4cdebbee060460dad5d6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:06.868181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6779c1c95ee4cdebbee060460dad5d6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:06.870497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:06.935670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:06.938016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6779c1c95ee4cdebbee060460dad5d6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:06.949665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6779c1c95ee4cdebbee060460dad5d6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:06.950632 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6779c1c95ee4cdebbee060460dad5d6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:06.951184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6779c1c95ee4cdebbee060460dad5d6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:06.958913 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9c75f144-636b-4053-ac92-9c50692934b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6779c1c95ee4cdebbee060460dad5d6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:06.979709 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1253/2520] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:06 2022] DELETE /identity/v3/users/e6779c1c95ee4cdebbee060460dad5d6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:07.202787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:07.227052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2022-9798-4803-ac7e-0ad8a50840dc service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:07.301198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:07.314365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:07.315594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.315929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.316151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] PATH_INFO: `/v3/projects/fca0b67ab14c4d78a56a5cd9695dc693` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.317379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca0b67ab14c4d78a56a5cd9695dc693)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:07.319337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:07.385072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca0b67ab14c4d78a56a5cd9695dc693', 'request_id': 'req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:07.393482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca0b67ab14c4d78a56a5cd9695dc693', 'request_id': 'req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:07.403032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca0b67ab14c4d78a56a5cd9695dc693', 'request_id': 'req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:07.414483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] The token cache is being invalidate because project fca0b67ab14c4d78a56a5cd9695dc693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:07.414774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:07.415780 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b12e21b5-1dc4-47b2-bfe3-098b5d3218de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:07.417200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1268/2521] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:07 2022] DELETE /identity/v3/projects/fca0b67ab14c4d78a56a5cd9695dc693 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:07.423168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90dde3-8065-49ce-9077-ee1eb28f2796 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.423550 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90dde3-8065-49ce-9077-ee1eb28f2796 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.424013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90dde3-8065-49ce-9077-ee1eb28f2796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.446130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9b90dde3-8065-49ce-9077-ee1eb28f2796 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:07.447396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9b90dde3-8065-49ce-9077-ee1eb28f2796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:07.533140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1254/2522] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:07.545324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247edc27-042a-45d5-b031-c1f1dc1ef775 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.545825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247edc27-042a-45d5-b031-c1f1dc1ef775 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.546144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247edc27-042a-45d5-b031-c1f1dc1ef775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.571467 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-247edc27-042a-45d5-b031-c1f1dc1ef775 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:07.573508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-247edc27-042a-45d5-b031-c1f1dc1ef775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:07.584638 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1269/2523] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:07.588973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90dde3-8065-49ce-9077-ee1eb28f2796 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:07.599574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90dde3-8065-49ce-9077-ee1eb28f2796 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:07.604805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:07.605526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.605876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.606214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.607085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:07.607519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:07.609177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:07.621855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1255/2524] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:10:07.628600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247edc27-042a-45d5-b031-c1f1dc1ef775 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:07.641658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247edc27-042a-45d5-b031-c1f1dc1ef775 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:07.646596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:07.647552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.647846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.648123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.648789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:07.650743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:07.684839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1270/2525] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:07 2022] POST /identity/v3/projects => generated 364 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:07.689659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:07.702123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555638d-834c-4bf6-a9d2-2d71712f174d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:07.790593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:07.790593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.790593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.790593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.791296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:07.791296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:07.815610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1256/2526] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:07 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:07.820137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:07.833034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc0e94-0ef4-40a2-9c6a-27da0762be3a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:07.837888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:07.838545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.838827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.839103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.839803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:07.841437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:07.852103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1271/2527] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:07 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:07.856687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:07.868150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644ebc5-0b81-43ea-9afb-92fa254da012 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:07.873479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd137256-e011-4505-a507-8caa8b6a89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:07.874586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd137256-e011-4505-a507-8caa8b6a89ef admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.874586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd137256-e011-4505-a507-8caa8b6a89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.874952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd137256-e011-4505-a507-8caa8b6a89ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.876616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd137256-e011-4505-a507-8caa8b6a89ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:07.878841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd137256-e011-4505-a507-8caa8b6a89ef admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:07.899963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1257/2528] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:07 2022] GET /identity/v3/roles => generated 1427 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:07.900753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:07.912836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a627c42-7d3a-423c-ae61-252734c1d5af admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:07.922073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:07.922815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.923102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.923404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] PATH_INFO: `/v3/projects/d324b7da17664d4abd85c42eca5dd9cb/users/4e1d59e7e96949db872d281d7e4a8fea/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:07.944581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d324b7da17664d4abd85c42eca5dd9cb, user_id=4e1d59e7e96949db872d281d7e4a8fea, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:07.948716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:07.969439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1272/2529] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:07 2022] PUT /identity/v3/projects/d324b7da17664d4abd85c42eca5dd9cb/users/4e1d59e7e96949db872d281d7e4a8fea/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:07.988295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583bfcf-7954-47df-b8ff-40180922c24a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:07.988804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583bfcf-7954-47df-b8ff-40180922c24a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:07.989282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583bfcf-7954-47df-b8ff-40180922c24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.026751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d583bfcf-7954-47df-b8ff-40180922c24a None None] MFA Rules not processed for user `4e1d59e7e96949db872d281d7e4a8fea`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:08.028038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d583bfcf-7954-47df-b8ff-40180922c24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:08.053561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:08.115367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1258/2530] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:08.120969 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.199955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869c9ff-7eff-4efa-86e2-12807bd17cb2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.206509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.207336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.207460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.207750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.208491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.210554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.244310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1273/2531] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:08 2022] POST /identity/v3/projects => generated 364 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:08.251342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583bfcf-7954-47df-b8ff-40180922c24a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.265222 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583bfcf-7954-47df-b8ff-40180922c24a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.332310 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.332948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.333233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.333510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.334184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.336274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.363385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.365213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:08.368711 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1259/2532] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:08 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:08.374778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.375053 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:08.380197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f69848-7f59-4789-8d6c-23b367bd2f5c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.389442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.389744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691dc2-bcf1-46eb-9d07-74d36ec863b3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.390621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.391156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.391573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] PATH_INFO: `/v3/users/87a058e462f740ccabea561ac09e7c6b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.393077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a058e462f740ccabea561ac09e7c6b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.395121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.395510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.396244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.397143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.397354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.398381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.400476 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.412773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1260/2533] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:08 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:08.417129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.430298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf932f4e-3e7c-4eea-979c-2be49c0f3768 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.435975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.436760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.437079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.437358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] PATH_INFO: `/v3/projects/ee21b0577fc84b108c3ebb9892c62e9a/users/b3bbd5da93dd4cad9669befac19fb726/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.458002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee21b0577fc84b108c3ebb9892c62e9a, user_id=b3bbd5da93dd4cad9669befac19fb726, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.461235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.464869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a058e462f740ccabea561ac09e7c6b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:08.476670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a058e462f740ccabea561ac09e7c6b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:08.482747 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1261/2534] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:08 2022] PUT /identity/v3/projects/ee21b0577fc84b108c3ebb9892c62e9a/users/b3bbd5da93dd4cad9669befac19fb726/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:08.487321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.498241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a058e462f740ccabea561ac09e7c6b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:08.499432 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a058e462f740ccabea561ac09e7c6b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:08.500267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f41a3f74-2412-4ef0-8e2c-3299737a7df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a058e462f740ccabea561ac09e7c6b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:08.519032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1274/2535] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:08 2022] DELETE /identity/v3/users/87a058e462f740ccabea561ac09e7c6b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:08.523811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.524101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.524380 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.546564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:08.548018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:08.575066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f682a8-0adc-4f16-8c6c-19e854a0bdf3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.600276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:08.637203 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1275/2536] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:08.648560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.649767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:08.662867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.663911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.663911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.664158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.664981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.666846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.677277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1262/2537] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:08 2022] GET /identity/v3/roles => generated 1427 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:08.682691 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.684926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:08.697785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff995b2e-2c2b-439a-bfaf-bdf4f60eb698 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.703555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0826d-730e-4a6e-9f06-8152f1b8f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.704247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0826d-730e-4a6e-9f06-8152f1b8f057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.704526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0826d-730e-4a6e-9f06-8152f1b8f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.704817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0826d-730e-4a6e-9f06-8152f1b8f057 admin admin] PATH_INFO: `/v3/projects/ee21b0577fc84b108c3ebb9892c62e9a/users/b3bbd5da93dd4cad9669befac19fb726/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.706917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0826d-730e-4a6e-9f06-8152f1b8f057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee21b0577fc84b108c3ebb9892c62e9a, user_id=b3bbd5da93dd4cad9669befac19fb726, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.709609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0826d-730e-4a6e-9f06-8152f1b8f057 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.723108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1263/2538] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:08 2022] PUT /identity/v3/projects/ee21b0577fc84b108c3ebb9892c62e9a/users/b3bbd5da93dd4cad9669befac19fb726/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:08.723422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442393c-efcb-4d0a-bafd-df28b83e4554 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.734284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.734582 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.734867 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.756354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:08.778064 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] MFA Rules not processed for user `b3bbd5da93dd4cad9669befac19fb726`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:08.780425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:08.787390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.788032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.788318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.788652 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.865481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.866912 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.869807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1264/2539] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:08.878544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1276/2540] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:08.887804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:08.891984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:08.960750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47877fcf-41eb-41a0-ba43-6fc2e61f4d67 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:08.964838 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:08.965503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:08.965786 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:08.966062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:08.975933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:08.977369 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:08.989528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1265/2541] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:09.087551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:09.097175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea755227-9af2-4bb5-93f0-5ab118df77c7 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:09.104106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:09.104854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:09.105206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:09.105554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:09.108075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:09.179531 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:09.180995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:09.192746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1277/2542] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:09.199384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:09.200855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:09.217567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6afab-baa3-413b-8ba5-e24d814c0fbe service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:09.222145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:09.222888 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:09.223174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:09.223450 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] PATH_INFO: `/v3/projects/c18ddb46ea1343ecaeddd1243c7ce3a1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:09.224776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18ddb46ea1343ecaeddd1243c7ce3a1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:09.226782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:09.278804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:09.305140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18ddb46ea1343ecaeddd1243c7ce3a1', 'request_id': 'req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.312817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18ddb46ea1343ecaeddd1243c7ce3a1', 'request_id': 'req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.320932 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18ddb46ea1343ecaeddd1243c7ce3a1', 'request_id': 'req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.333389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] The token cache is being invalidate because project c18ddb46ea1343ecaeddd1243c7ce3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:09.333979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.334905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.337077 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1266/2543] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:09 2022] DELETE /identity/v3/projects/c18ddb46ea1343ecaeddd1243c7ce3a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:09.342226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:09.367645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43c118-58e8-48c0-b0a3-14d19bdbccc2 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:09.438122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:09.438824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:09.439106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:09.439385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] PATH_INFO: `/v3/users/4fb27d3009f940e5a91993dbcffd2fe9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:09.440601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb27d3009f940e5a91993dbcffd2fe9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:09.442619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:09.469235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:09.499829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb27d3009f940e5a91993dbcffd2fe9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.511756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb27d3009f940e5a91993dbcffd2fe9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.526155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb27d3009f940e5a91993dbcffd2fe9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.527382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb27d3009f940e5a91993dbcffd2fe9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.528118 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5033e5ad-489e-4d98-9037-99963256f591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb27d3009f940e5a91993dbcffd2fe9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:09.544028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1278/2544] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:09 2022] DELETE /identity/v3/users/4fb27d3009f940e5a91993dbcffd2fe9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:09.875997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:09.877576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:09.893093 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c83a6-ea8f-45b5-8e83-c1cdfad92f6d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:09.961801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:09.962489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:09.962775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:09.963052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] PATH_INFO: `/v3/projects/c98f54c20c6443e39bd78d8a260211a7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:09.964288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98f54c20c6443e39bd78d8a260211a7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:09.966865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.019701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98f54c20c6443e39bd78d8a260211a7', 'request_id': 'req-a667ee38-3d2f-4e52-ac02-07cae3b90585'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:10.027162 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98f54c20c6443e39bd78d8a260211a7', 'request_id': 'req-a667ee38-3d2f-4e52-ac02-07cae3b90585'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:10.038872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98f54c20c6443e39bd78d8a260211a7', 'request_id': 'req-a667ee38-3d2f-4e52-ac02-07cae3b90585'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:10.051789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] The token cache is being invalidate because project c98f54c20c6443e39bd78d8a260211a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:10.052111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:10.052735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a667ee38-3d2f-4e52-ac02-07cae3b90585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:10.054320 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1267/2545] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:09 2022] DELETE /identity/v3/projects/c98f54c20c6443e39bd78d8a260211a7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:10.061785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72055fb-5eee-41e1-831d-0a99b1299c77 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.062075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72055fb-5eee-41e1-831d-0a99b1299c77 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.062513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72055fb-5eee-41e1-831d-0a99b1299c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.092706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d72055fb-5eee-41e1-831d-0a99b1299c77 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:10.094191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d72055fb-5eee-41e1-831d-0a99b1299c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:10.160210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1279/2546] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:10.168972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b5c2-28b3-46be-bba2-d9335254bf2c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.168972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b5c2-28b3-46be-bba2-d9335254bf2c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.173749 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b5c2-28b3-46be-bba2-d9335254bf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.189712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1ff7b5c2-28b3-46be-bba2-d9335254bf2c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:10.191028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ff7b5c2-28b3-46be-bba2-d9335254bf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:10.199880 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1268/2547] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:10.204882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72055fb-5eee-41e1-831d-0a99b1299c77 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.215298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72055fb-5eee-41e1-831d-0a99b1299c77 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.221005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.221651 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.221937 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.222215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.222972 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:10.223282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.224931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.238588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1280/2548] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:10:10.243179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b5c2-28b3-46be-bba2-d9335254bf2c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.253099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b5c2-28b3-46be-bba2-d9335254bf2c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.257929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.258604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.258892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.259170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.259856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.261805 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.301902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1269/2549] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:10 2022] POST /identity/v3/projects => generated 378 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:10.306227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.317303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870a025-269e-457b-89da-23ab9d17eac4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.380741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.381391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.381655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.382124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.382846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.384797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.412187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1281/2550] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:10 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:10.417160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.430920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67b02-2e6c-4ebe-a174-5469df4eed00 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.438273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.439177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.439627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.440113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.441133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.443121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.458586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1270/2551] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:10 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:10.460259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.471586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d627d27-794d-4ee1-950e-8d00828dd246 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.476592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d624506-989e-4710-8ee4-f56ee1fdff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.477226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624506-989e-4710-8ee4-f56ee1fdff49 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.477509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624506-989e-4710-8ee4-f56ee1fdff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.477781 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d624506-989e-4710-8ee4-f56ee1fdff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.478528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d624506-989e-4710-8ee4-f56ee1fdff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.480483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d624506-989e-4710-8ee4-f56ee1fdff49 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.492128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1282/2552] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:10 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:10.496516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.503773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:10.509295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc652d8-144a-41d0-b4ac-416119ede176 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.520416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.521124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.521423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.521702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] PATH_INFO: `/v3/projects/4e6538acdf4e4f0dba80c6659e7f46d9/users/5a7c94ba42464cb9b30d10d2fbd99c25/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.539583 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6538acdf4e4f0dba80c6659e7f46d9, user_id=5a7c94ba42464cb9b30d10d2fbd99c25, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.542321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.557152 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1271/2553] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:10 2022] PUT /identity/v3/projects/4e6538acdf4e4f0dba80c6659e7f46d9/users/5a7c94ba42464cb9b30d10d2fbd99c25/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:10.570447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b836-3625-4f52-b869-e65ab7c074ce None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.570952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b836-3625-4f52-b869-e65ab7c074ce None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.571255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b836-3625-4f52-b869-e65ab7c074ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.587550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:10.621818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a763b836-3625-4f52-b869-e65ab7c074ce None None] MFA Rules not processed for user `5a7c94ba42464cb9b30d10d2fbd99c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:10.623702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a763b836-3625-4f52-b869-e65ab7c074ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:10.705676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1283/2554] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:10.710299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.789758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fb76b-2a08-4ac6-b91f-6a484a4e5c9a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.796278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.796278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.797170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.797170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.797502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.799356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.834785 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1272/2555] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:10 2022] POST /identity/v3/projects => generated 376 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:10.839662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763b836-3625-4f52-b869-e65ab7c074ce None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.864664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763b836-3625-4f52-b869-e65ab7c074ce None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:10.948507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:10.949187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:10.949468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:10.949750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:10.950556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:10.952680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:10.982429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1284/2556] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:10 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:10.987073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:10.999178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15314416-f18a-4485-96b7-bb41f5450d5c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:11.004238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:11.004900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:11.005183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:11.005462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:11.006183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:11.007881 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:11.021137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1273/2557] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:10 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:11.027025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:11.037955 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabff15c-32ea-41da-89df-376340cfbd90 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:11.042936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:11.043600 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:11.043889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:11.044684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] PATH_INFO: `/v3/projects/c61267a95d654423a04c94483e4b09c5/users/58d2ea06bdc6480681df934458a7a0bf/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:11.061714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61267a95d654423a04c94483e4b09c5, user_id=58d2ea06bdc6480681df934458a7a0bf, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:11.064469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:11.078311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1285/2558] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:11 2022] PUT /identity/v3/projects/c61267a95d654423a04c94483e4b09c5/users/58d2ea06bdc6480681df934458a7a0bf/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:11.082547 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:11.093677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8f6d0-edc9-4162-b82b-72153be7701b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:11.158620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634db592-99e7-4e3d-80b1-433acad82d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:11.159232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db592-99e7-4e3d-80b1-433acad82d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:11.159519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db592-99e7-4e3d-80b1-433acad82d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:11.159798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634db592-99e7-4e3d-80b1-433acad82d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:11.160506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634db592-99e7-4e3d-80b1-433acad82d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:11.162173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634db592-99e7-4e3d-80b1-433acad82d80 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:11.173712 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1274/2559] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:11 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:11.178150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:11.189325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8af714-97c4-4e40-801d-867db6e4bd67 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:11.194052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:11.194789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:11.195079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:11.195361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] PATH_INFO: `/v3/projects/c61267a95d654423a04c94483e4b09c5/users/58d2ea06bdc6480681df934458a7a0bf/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:11.197394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61267a95d654423a04c94483e4b09c5, user_id=58d2ea06bdc6480681df934458a7a0bf, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:11.200124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:11.211559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1286/2560] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:11 2022] PUT /identity/v3/projects/c61267a95d654423a04c94483e4b09c5/users/58d2ea06bdc6480681df934458a7a0bf/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:11.223520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:11.223815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:11.224099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:11.253915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] MFA Rules not processed for user `58d2ea06bdc6480681df934458a7a0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:11.255211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:11.299503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:11.328437 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1275/2561] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:11.339873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:11.342081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:11.398470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:11.408066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714538-d5b8-4df0-b3b7-18ccb3310bb0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:11.412191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131eba-2775-46df-a92f-7e4292f3d9c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:11.412839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131eba-2775-46df-a92f-7e4292f3d9c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:11.413121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131eba-2775-46df-a92f-7e4292f3d9c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:11.413394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131eba-2775-46df-a92f-7e4292f3d9c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:11.472120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce131eba-2775-46df-a92f-7e4292f3d9c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:11.473578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce131eba-2775-46df-a92f-7e4292f3d9c0 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:11.482704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1287/2562] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:12.039917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:12.041432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:12.154706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c73490-a334-468a-a28e-1cc5a8be2c5a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:12.159576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:12.160273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:12.160557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:12.160841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] PATH_INFO: `/v3/users/4e1d59e7e96949db872d281d7e4a8fea` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:12.162127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1d59e7e96949db872d281d7e4a8fea)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:12.164122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:12.238508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1d59e7e96949db872d281d7e4a8fea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.246139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1d59e7e96949db872d281d7e4a8fea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.247048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1d59e7e96949db872d281d7e4a8fea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.248508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1d59e7e96949db872d281d7e4a8fea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.259551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1d59e7e96949db872d281d7e4a8fea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.286578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1276/2563] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:12 2022] DELETE /identity/v3/users/4e1d59e7e96949db872d281d7e4a8fea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:12.291282 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:12.291571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:12.291849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:12.313396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:12.314704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:12.380707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1288/2564] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:12.391397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:12.392937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:12.457626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104593-d269-4bf0-a5fa-c4d23571b843 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:12.461473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:12.462108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:12.462416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:12.462694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:12.473055 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:12.474536 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:12.478758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:12.486156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1277/2565] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:12.803320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:12.805431 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:12.837132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540b448-0d2e-4794-bd2d-d5bbb4b9e2f2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:12.844320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:12.845176 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:12.845603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:12.845987 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] PATH_INFO: `/v3/projects/d324b7da17664d4abd85c42eca5dd9cb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:12.849961 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d324b7da17664d4abd85c42eca5dd9cb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:12.853257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:12.911827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:12.913827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:12.939414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd324b7da17664d4abd85c42eca5dd9cb', 'request_id': 'req-572db7b7-075c-486c-afb0-f0e5a240235f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.949977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd324b7da17664d4abd85c42eca5dd9cb', 'request_id': 'req-572db7b7-075c-486c-afb0-f0e5a240235f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.961441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd324b7da17664d4abd85c42eca5dd9cb', 'request_id': 'req-572db7b7-075c-486c-afb0-f0e5a240235f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.975296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] The token cache is being invalidate because project d324b7da17664d4abd85c42eca5dd9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:12.975629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.976318 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:12.977910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1289/2566] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:12 2022] DELETE /identity/v3/projects/d324b7da17664d4abd85c42eca5dd9cb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:12.982392 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:12.985131 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:12.995294 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5215574-272e-4fc7-9592-fcec47463cc8 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:13.021818 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:13.060223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:13.060952 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:13.061198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:13.061481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:13.064257 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:13.067059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572db7b7-075c-486c-afb0-f0e5a240235f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:13.072929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:13.073602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:13.074009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:13.074199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] PATH_INFO: `/v3/users/b3bbd5da93dd4cad9669befac19fb726` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:13.076050 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3bbd5da93dd4cad9669befac19fb726)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:13.078077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:13.152224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:13.155599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:13.159528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3bbd5da93dd4cad9669befac19fb726'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.168667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3bbd5da93dd4cad9669befac19fb726'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.173356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1278/2567] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:13.185284 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3bbd5da93dd4cad9669befac19fb726'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.186059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3bbd5da93dd4cad9669befac19fb726'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.186739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-26f4eba4-6de0-460e-82bf-d95556a1d762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3bbd5da93dd4cad9669befac19fb726'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.206518 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1290/2568] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:12 2022] DELETE /identity/v3/users/b3bbd5da93dd4cad9669befac19fb726 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:13.535387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:13.547409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a91cd-e826-483f-afd1-e6e569ace958 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:13.611249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:13.611895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:13.612177 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:13.612453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] PATH_INFO: `/v3/projects/ee21b0577fc84b108c3ebb9892c62e9a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:13.613600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee21b0577fc84b108c3ebb9892c62e9a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:13.615639 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:13.622692 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:13.665330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee21b0577fc84b108c3ebb9892c62e9a', 'request_id': 'req-0f106cc0-03e2-4c8d-baef-a48f434ec50c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.672743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee21b0577fc84b108c3ebb9892c62e9a', 'request_id': 'req-0f106cc0-03e2-4c8d-baef-a48f434ec50c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.681647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee21b0577fc84b108c3ebb9892c62e9a', 'request_id': 'req-0f106cc0-03e2-4c8d-baef-a48f434ec50c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.693621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] The token cache is being invalidate because project ee21b0577fc84b108c3ebb9892c62e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:13.693915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.694650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f106cc0-03e2-4c8d-baef-a48f434ec50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:13.696234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1279/2569] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:13 2022] DELETE /identity/v3/projects/ee21b0577fc84b108c3ebb9892c62e9a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:13.701414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d6eb9-600e-422f-bfe3-671c66d20884 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:13.701704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d6eb9-600e-422f-bfe3-671c66d20884 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:13.702095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d6eb9-600e-422f-bfe3-671c66d20884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:13.721648 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fe3d6eb9-600e-422f-bfe3-671c66d20884 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:13.722873 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fe3d6eb9-600e-422f-bfe3-671c66d20884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:13.792248 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1291/2570] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:13.801023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1f934-0e6b-49f7-bb4b-a87e3f4b2f3a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:13.801417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1f934-0e6b-49f7-bb4b-a87e3f4b2f3a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:13.801819 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1f934-0e6b-49f7-bb4b-a87e3f4b2f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:13.822468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e0a1f934-0e6b-49f7-bb4b-a87e3f4b2f3a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:13.823719 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e0a1f934-0e6b-49f7-bb4b-a87e3f4b2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:13.831798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1280/2571] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:13.836271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d6eb9-600e-422f-bfe3-671c66d20884 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:13.852014 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d6eb9-600e-422f-bfe3-671c66d20884 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:13.857257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:13.857919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:13.858199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:13.858503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:13.859205 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:13.859510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:13.861120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:13.873833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1292/2572] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:10:13.878351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1f934-0e6b-49f7-bb4b-a87e3f4b2f3a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:13.887895 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1f934-0e6b-49f7-bb4b-a87e3f4b2f3a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:13.893172 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:13.893813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:13.894098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:13.894402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:13.895129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:13.897309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:13.935780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1281/2573] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:13 2022] POST /identity/v3/projects => generated 386 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:13.940133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:13.950481 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691270e-0917-4af6-8c5f-f5f39c3016f2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:13.980344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:14.012423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.013482 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.013756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.014018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.014742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.016680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.041807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1293/2574] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:13 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:14.046990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.058448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91eb66b-89d3-4345-9ee7-2972a3a436ff admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.065592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.066213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.066533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.066809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.067502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.069103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.080317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1282/2575] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:14 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:14.086704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.100268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef8d81-cb06-44f2-9f4c-9fef153fa7c5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.105308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926030a-696b-4c7e-b969-fc401ffa0885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.108371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926030a-696b-4c7e-b969-fc401ffa0885 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.108371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926030a-696b-4c7e-b969-fc401ffa0885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.108371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926030a-696b-4c7e-b969-fc401ffa0885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.108371 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926030a-696b-4c7e-b969-fc401ffa0885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.110447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926030a-696b-4c7e-b969-fc401ffa0885 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.125640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1294/2576] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:14 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:14.130316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.141263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda6759-1c6e-474c-a694-817b11bf42e9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.146539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.147610 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.148004 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.148336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] PATH_INFO: `/v3/projects/c43fc2a6a46c495d9a73d5563ffaa3ba/users/0ba59d4746354763b8b39b48c54507e3/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.165307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43fc2a6a46c495d9a73d5563ffaa3ba, user_id=0ba59d4746354763b8b39b48c54507e3, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.168052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.184030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1283/2577] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:14 2022] PUT /identity/v3/projects/c43fc2a6a46c495d9a73d5563ffaa3ba/users/0ba59d4746354763b8b39b48c54507e3/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:14.196018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951ba89-1515-4bf8-b0e9-2e913a9ea5cc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.196327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951ba89-1515-4bf8-b0e9-2e913a9ea5cc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.196630 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951ba89-1515-4bf8-b0e9-2e913a9ea5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.226154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9951ba89-1515-4bf8-b0e9-2e913a9ea5cc None None] MFA Rules not processed for user `0ba59d4746354763b8b39b48c54507e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:14.227423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9951ba89-1515-4bf8-b0e9-2e913a9ea5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:14.296850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1295/2578] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:14.301444 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.374472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944191a8-1914-46c8-890d-3baf700ac66e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.381731 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.382751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.383203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.383658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.384798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.386908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.427170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1284/2579] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:14 2022] POST /identity/v3/projects => generated 388 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:14.433010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951ba89-1515-4bf8-b0e9-2e913a9ea5cc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.448215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951ba89-1515-4bf8-b0e9-2e913a9ea5cc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.508503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.509136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.509417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.509687 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.510399 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.512655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.538819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1296/2580] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:14 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:14.543407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.553767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51a34-4d61-4cc9-a610-8cea331fe017 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.558756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.559393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.559679 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.559962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.560801 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.562479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.574169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1285/2581] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:14 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:14.579476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.595875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad02ee9-383e-4ca7-810d-aff1e4329cf3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.600908 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d0c79-6959-4f92-a0af-f2cd487de354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.601551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d0c79-6959-4f92-a0af-f2cd487de354 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.601816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d0c79-6959-4f92-a0af-f2cd487de354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.602092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d0c79-6959-4f92-a0af-f2cd487de354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.602827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d0c79-6959-4f92-a0af-f2cd487de354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.604695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d0c79-6959-4f92-a0af-f2cd487de354 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.621534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1297/2582] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:14 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:14.627160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.635027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:14.641871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71302dcd-00f0-4cde-bdb0-4b81dd5f8afd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.650562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.651636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.651998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.652688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] PATH_INFO: `/v3/projects/fc0273b4270c4504b5f550e74a100a23/users/441843d9bcdc4b808ce782cd49584645/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.671806 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0273b4270c4504b5f550e74a100a23, user_id=441843d9bcdc4b808ce782cd49584645, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.674617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.692501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1286/2583] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:14 2022] PUT /identity/v3/projects/fc0273b4270c4504b5f550e74a100a23/users/441843d9bcdc4b808ce782cd49584645/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:14.711896 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74c2e3-acf6-4810-b2a5-5aaf44c14273 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.712189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74c2e3-acf6-4810-b2a5-5aaf44c14273 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.712493 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74c2e3-acf6-4810-b2a5-5aaf44c14273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.759097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ec74c2e3-acf6-4810-b2a5-5aaf44c14273 None None] MFA Rules not processed for user `441843d9bcdc4b808ce782cd49584645`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:14.759097 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ec74c2e3-acf6-4810-b2a5-5aaf44c14273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:14.777158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:14.871855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1298/2584] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:14.877118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:14.955874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd785128-48c2-4fa9-844a-65bd9b6cca4c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:14.961272 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:14.961909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:14.962192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:14.962506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:14.963193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:14.965140 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:14.998824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1287/2585] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:14 2022] POST /identity/v3/projects => generated 388 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:15.002795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74c2e3-acf6-4810-b2a5-5aaf44c14273 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:15.020363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74c2e3-acf6-4810-b2a5-5aaf44c14273 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:15.099509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:15.100079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:15.100365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:15.100643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:15.101347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:15.103430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:15.132068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1299/2586] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:15 2022] POST /identity/v3/users => generated 301 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:15.137331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:15.149264 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81120dcd-04ed-46f4-b714-eb070f1d3a02 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:15.155024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:15.155929 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:15.156224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:15.156501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:15.157412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:15.158857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:15.176746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1288/2587] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:15 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:15.183316 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:15.197332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119b977-aaad-4000-a6ae-c79bf41f55a2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:15.208180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:15.208885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:15.209156 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:15.209445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] PATH_INFO: `/v3/projects/70ab527786924ca4a3b811d6658d57eb/users/a9b8de60cd2e4d798b4d4819e055522a/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:15.226616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ab527786924ca4a3b811d6658d57eb, user_id=a9b8de60cd2e4d798b4d4819e055522a, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:15.229323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:15.242470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1300/2588] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:15 2022] PUT /identity/v3/projects/70ab527786924ca4a3b811d6658d57eb/users/a9b8de60cd2e4d798b4d4819e055522a/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:15.246907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:15.261348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a24f5-80b1-4102-89ea-9fee55fb8d91 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:15.324664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe14ad6-dedd-4d5c-a30b-460199846b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:15.325850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14ad6-dedd-4d5c-a30b-460199846b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:15.326146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14ad6-dedd-4d5c-a30b-460199846b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:15.326453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe14ad6-dedd-4d5c-a30b-460199846b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:15.327166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe14ad6-dedd-4d5c-a30b-460199846b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:15.328792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe14ad6-dedd-4d5c-a30b-460199846b16 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:15.339394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1289/2589] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:15 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:15.344608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:15.358172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77e60-d4aa-4e41-938d-df78cb2d6f60 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:15.363452 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:15.364241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:15.364575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:15.364893 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] PATH_INFO: `/v3/projects/70ab527786924ca4a3b811d6658d57eb/users/a9b8de60cd2e4d798b4d4819e055522a/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:15.367063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ab527786924ca4a3b811d6658d57eb, user_id=a9b8de60cd2e4d798b4d4819e055522a, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:15.369826 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:15.380928 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1301/2590] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:15 2022] PUT /identity/v3/projects/70ab527786924ca4a3b811d6658d57eb/users/a9b8de60cd2e4d798b4d4819e055522a/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:15.393517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31712ef-5bc4-4816-91b7-66f1ec046b04 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:15.393971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31712ef-5bc4-4816-91b7-66f1ec046b04 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:15.394505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31712ef-5bc4-4816-91b7-66f1ec046b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:15.429400 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f31712ef-5bc4-4816-91b7-66f1ec046b04 None None] MFA Rules not processed for user `a9b8de60cd2e4d798b4d4819e055522a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:15.430689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f31712ef-5bc4-4816-91b7-66f1ec046b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:15.488473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:15.524874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1290/2591] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:15.538951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:15.540733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:15.615940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668f4e-b445-411e-a259-3d03f6182401 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:15.629200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:15.630425 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:15.630715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:15.631039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:15.641907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:15.643412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:15.654699 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1302/2592] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:16.322394 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31712ef-5bc4-4816-91b7-66f1ec046b04 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:16.332991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31712ef-5bc4-4816-91b7-66f1ec046b04 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:16.336586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e87f9b-bdd8-4786-952d-defc30e77a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:16.337205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87f9b-bdd8-4786-952d-defc30e77a71 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:16.337491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87f9b-bdd8-4786-952d-defc30e77a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:16.337837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87f9b-bdd8-4786-952d-defc30e77a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:16.402653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e87f9b-bdd8-4786-952d-defc30e77a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:16.404134 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e87f9b-bdd8-4786-952d-defc30e77a71 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:16.415073 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1291/2593] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:17.372709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:17.374138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:17.379655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:17.469732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d2521-296a-45ca-9a56-c056ce733948 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:17.474737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:17.475398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:17.475680 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:17.475952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] PATH_INFO: `/v3/users/5a7c94ba42464cb9b30d10d2fbd99c25` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:17.477151 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7c94ba42464cb9b30d10d2fbd99c25)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:17.479134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:17.532309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7c94ba42464cb9b30d10d2fbd99c25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:17.539810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7c94ba42464cb9b30d10d2fbd99c25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:17.555346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7c94ba42464cb9b30d10d2fbd99c25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:17.556274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7c94ba42464cb9b30d10d2fbd99c25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:17.556992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7c94ba42464cb9b30d10d2fbd99c25'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:17.573209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1303/2594] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:17 2022] DELETE /identity/v3/users/5a7c94ba42464cb9b30d10d2fbd99c25 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:17.579650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:17.580365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:17.580365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:17.601319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:17.602849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:17.685756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1292/2595] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:17.696900 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:17.698554 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:17.765078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab875a1-d16c-4c5b-9562-6b7a6df2df7b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:17.768882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:17.769528 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:17.769813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:17.770085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:17.780194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:17.781642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:17.791581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1304/2596] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:18.117224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:18.119258 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:18.133059 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d540bf0-35e6-4645-a1ec-7e42869cec63 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:18.138449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:18.139384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:18.139777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:18.140076 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] PATH_INFO: `/v3/projects/4e6538acdf4e4f0dba80c6659e7f46d9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:18.141332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6538acdf4e4f0dba80c6659e7f46d9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:18.143296 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:18.211477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6538acdf4e4f0dba80c6659e7f46d9', 'request_id': 'req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.220127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6538acdf4e4f0dba80c6659e7f46d9', 'request_id': 'req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.228071 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6538acdf4e4f0dba80c6659e7f46d9', 'request_id': 'req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.236505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:18.240910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] The token cache is being invalidate because project 4e6538acdf4e4f0dba80c6659e7f46d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:18.241367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.242656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.244754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1293/2597] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:18 2022] DELETE /identity/v3/projects/4e6538acdf4e4f0dba80c6659e7f46d9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:18.250757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:18.268095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebfd2d-3dd3-4c58-9527-f674c7527ade service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:18.300936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:18.349000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:18.349679 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:18.349958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:18.350231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] PATH_INFO: `/v3/users/58d2ea06bdc6480681df934458a7a0bf` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:18.351633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d2ea06bdc6480681df934458a7a0bf)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:18.353636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:18.416299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d2ea06bdc6480681df934458a7a0bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.423910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d2ea06bdc6480681df934458a7a0bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.436382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d2ea06bdc6480681df934458a7a0bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.437128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d2ea06bdc6480681df934458a7a0bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.437753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d9a5c6f5-641f-41c4-a14f-8f3d731534a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d2ea06bdc6480681df934458a7a0bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.459012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1305/2598] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:18 2022] DELETE /identity/v3/users/58d2ea06bdc6480681df934458a7a0bf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:18.766026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:18.768423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:18.785976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2318-5fc0-4fee-9c1f-7a1e21caff7a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:18.856865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:18.857534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:18.857822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:18.858102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] PATH_INFO: `/v3/projects/c61267a95d654423a04c94483e4b09c5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:18.859412 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61267a95d654423a04c94483e4b09c5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:18.861381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:18.923503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61267a95d654423a04c94483e4b09c5', 'request_id': 'req-c049c92e-4d0b-4385-afd4-7ffa45f9790a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.934008 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61267a95d654423a04c94483e4b09c5', 'request_id': 'req-c049c92e-4d0b-4385-afd4-7ffa45f9790a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.945730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61267a95d654423a04c94483e4b09c5', 'request_id': 'req-c049c92e-4d0b-4385-afd4-7ffa45f9790a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.959532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] The token cache is being invalidate because project c61267a95d654423a04c94483e4b09c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:18.959821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.960485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c049c92e-4d0b-4385-afd4-7ffa45f9790a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:18.962213 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1294/2599] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:18 2022] DELETE /identity/v3/projects/c61267a95d654423a04c94483e4b09c5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:18.967782 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5595be-7735-4126-9ed9-7fb2b56f2906 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:18.968220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5595be-7735-4126-9ed9-7fb2b56f2906 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:18.968599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5595be-7735-4126-9ed9-7fb2b56f2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:18.989745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ec5595be-7735-4126-9ed9-7fb2b56f2906 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:18.991026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ec5595be-7735-4126-9ed9-7fb2b56f2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:19.055923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1306/2600] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:19.064839 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eb404-d044-4cf4-9d87-1ce596dddfc2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.065063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eb404-d044-4cf4-9d87-1ce596dddfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.065345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eb404-d044-4cf4-9d87-1ce596dddfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.086474 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bd9eb404-d044-4cf4-9d87-1ce596dddfc2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:19.088338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bd9eb404-d044-4cf4-9d87-1ce596dddfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:19.100812 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1295/2601] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:19.106947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5595be-7735-4126-9ed9-7fb2b56f2906 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.119926 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5595be-7735-4126-9ed9-7fb2b56f2906 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.129750 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.130766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.131235 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.131703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.132815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:19.133353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.136189 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.155497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1307/2602] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:10:19.159199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eb404-d044-4cf4-9d87-1ce596dddfc2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.178627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eb404-d044-4cf4-9d87-1ce596dddfc2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.183842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.185052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.185348 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.185624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.186338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.188372 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.228339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1296/2603] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:19 2022] POST /identity/v3/projects => generated 388 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:19.229375 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.242593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4278aba-02b0-42ed-94fc-47933da64aa8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.286563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:19.330500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.331038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.331319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.331593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.334324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.334324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.364175 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1308/2604] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:19 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:19.368633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.380901 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00cecc-3a3e-43b9-a3de-dbefd87d47a7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.386521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.387240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.387574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.387862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.388984 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.391629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.406115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1297/2605] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:19 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:19.411416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.425264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912549ad-887e-4956-88fe-eade4ebcee35 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.432524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ace17-28c5-4c3e-8f57-cd26a918f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.433456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ace17-28c5-4c3e-8f57-cd26a918f518 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.434028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ace17-28c5-4c3e-8f57-cd26a918f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.435075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ace17-28c5-4c3e-8f57-cd26a918f518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.436406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ace17-28c5-4c3e-8f57-cd26a918f518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.439079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ace17-28c5-4c3e-8f57-cd26a918f518 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.452209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1309/2606] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:19 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:19.456114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.468966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145b9b3-9e2a-48ba-b661-14d96f10fea9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.478804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.479614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.479809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.480113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] PATH_INFO: `/v3/projects/8753877fda4c4dafa6b9adf49a69789c/users/6e3e20954d9842f0982985cd5aea65c9/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.507789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8753877fda4c4dafa6b9adf49a69789c, user_id=6e3e20954d9842f0982985cd5aea65c9, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.511788 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.533341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1298/2607] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:19 2022] PUT /identity/v3/projects/8753877fda4c4dafa6b9adf49a69789c/users/6e3e20954d9842f0982985cd5aea65c9/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:19.547517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae5b9-6ae5-44a9-8455-e4640d710b91 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.548008 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae5b9-6ae5-44a9-8455-e4640d710b91 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.548301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae5b9-6ae5-44a9-8455-e4640d710b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.586308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1a5ae5b9-6ae5-44a9-8455-e4640d710b91 None None] MFA Rules not processed for user `6e3e20954d9842f0982985cd5aea65c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:19.590613 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1a5ae5b9-6ae5-44a9-8455-e4640d710b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:19.679572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1310/2608] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:19.684273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.713628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:19.751061 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e1297-a3e7-48f0-aed8-4cd1b646a412 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.755965 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.756604 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.756892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.757173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.757894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.759861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.789374 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1299/2609] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:19 2022] POST /identity/v3/projects => generated 390 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:19.796407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ae5b9-6ae5-44a9-8455-e4640d710b91 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.810905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ae5b9-6ae5-44a9-8455-e4640d710b91 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.871789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.872343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.872646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.872910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.873582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.875769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.900686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1311/2610] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:19 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:19.909685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.920304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f770d4-f889-4c97-a4ee-91e13f879b98 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.926426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.927171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.927553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.927926 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.928535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.930130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:19.942160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1300/2611] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:19 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:19.946704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:19.959857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948710-6102-48b3-89ca-b2c238523fde admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:19.964988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:19.966307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:19.966701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:19.966999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] PATH_INFO: `/v3/projects/89082242e4fa4215939775ba21bf7b5b/users/3e5e409bde534d79836c6e00128d9f63/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:19.984887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89082242e4fa4215939775ba21bf7b5b, user_id=3e5e409bde534d79836c6e00128d9f63, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:19.987629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:20.002460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1312/2612] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:19 2022] PUT /identity/v3/projects/89082242e4fa4215939775ba21bf7b5b/users/3e5e409bde534d79836c6e00128d9f63/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:20.008193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:20.019630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665fbe-5887-48cb-abc3-bfad7ada4c72 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:20.081260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888cfab-be7e-401c-800f-a9a421bfe5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:20.081947 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cfab-be7e-401c-800f-a9a421bfe5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.082285 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cfab-be7e-401c-800f-a9a421bfe5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.082634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cfab-be7e-401c-800f-a9a421bfe5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:20.083411 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888cfab-be7e-401c-800f-a9a421bfe5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:20.085185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888cfab-be7e-401c-800f-a9a421bfe5cc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:20.095825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1301/2613] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:20 2022] GET /identity/v3/roles => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:20.100701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:20.109372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:20.114132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e04df-4bb1-4243-88a7-4ce33108d1a0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:20.120428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:20.121111 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.121394 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.122525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] PATH_INFO: `/v3/projects/89082242e4fa4215939775ba21bf7b5b/users/3e5e409bde534d79836c6e00128d9f63/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:20.124437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=89082242e4fa4215939775ba21bf7b5b, user_id=3e5e409bde534d79836c6e00128d9f63, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:20.127184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:20.138973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1313/2614] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:20 2022] PUT /identity/v3/projects/89082242e4fa4215939775ba21bf7b5b/users/3e5e409bde534d79836c6e00128d9f63/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:20.208584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad064f-fa65-4c2a-8660-e271eb0cbba4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.208878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad064f-fa65-4c2a-8660-e271eb0cbba4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.209161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad064f-fa65-4c2a-8660-e271eb0cbba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:20.237186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c3ad064f-fa65-4c2a-8660-e271eb0cbba4 None None] MFA Rules not processed for user `3e5e409bde534d79836c6e00128d9f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:20.238549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c3ad064f-fa65-4c2a-8660-e271eb0cbba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:20.315241 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1302/2615] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:20.326924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:20.328852 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:20.388301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f8a5b-87be-499a-9719-abcbdd427ede admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:20.392186 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:20.392830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.393107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.393422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:20.403236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:20.404670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:20.414122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1314/2616] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:20.556139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad064f-fa65-4c2a-8660-e271eb0cbba4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:20.581282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:20.648380 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad064f-fa65-4c2a-8660-e271eb0cbba4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:20.655146 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:20.655823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.656102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.656381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] PATH_INFO: `/v3/users/6e3e20954d9842f0982985cd5aea65c9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:20.657585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3e20954d9842f0982985cd5aea65c9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:20.659556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:20.720461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3e20954d9842f0982985cd5aea65c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:20.728141 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3e20954d9842f0982985cd5aea65c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:20.728830 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3e20954d9842f0982985cd5aea65c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:20.729497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3e20954d9842f0982985cd5aea65c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:20.738563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9abea17e-6984-40ef-afcc-fd36b022282d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3e20954d9842f0982985cd5aea65c9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:20.757144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:20.757652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1303/2617] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:20 2022] DELETE /identity/v3/users/6e3e20954d9842f0982985cd5aea65c9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:20.758634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:20.762467 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.763002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.763490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:20.770556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633b10e-cb28-448e-ab28-f97b99f42d93 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:20.789577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:20.790840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:20.832848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:20.833496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.833784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.834147 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:20.835977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:20.872362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1304/2618] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:20.882878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:20.884354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:20.919512 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:20.924367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:20.934933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1315/2619] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:20.964541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:20.989906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b116c5-bf12-4cd2-aaff-a79c4172e521 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:20.995684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:20.996689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:20.997199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:20.997671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:21.011531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:21.013131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:21.023578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1305/2620] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:21.335853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:21.337442 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:21.358505 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33a30-7675-4508-8b6b-6e840610b41d service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:21.365550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:21.366230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:21.366542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:21.366910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] PATH_INFO: `/v3/projects/8753877fda4c4dafa6b9adf49a69789c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:21.369150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8753877fda4c4dafa6b9adf49a69789c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:21.371343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:21.424368 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:21.428897 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8753877fda4c4dafa6b9adf49a69789c', 'request_id': 'req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.437737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8753877fda4c4dafa6b9adf49a69789c', 'request_id': 'req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.446890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8753877fda4c4dafa6b9adf49a69789c', 'request_id': 'req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.457496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] The token cache is being invalidate because project 8753877fda4c4dafa6b9adf49a69789c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:21.457790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.458492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.460005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1316/2621] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:21 2022] DELETE /identity/v3/projects/8753877fda4c4dafa6b9adf49a69789c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:21.464049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:21.475683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577b62-baa5-42f1-95e9-a4e469827106 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:21.549067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:21.549717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:21.549998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:21.550299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] PATH_INFO: `/v3/users/3e5e409bde534d79836c6e00128d9f63` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:21.551517 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5e409bde534d79836c6e00128d9f63)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:21.553423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:21.614569 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5e409bde534d79836c6e00128d9f63'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.626678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5e409bde534d79836c6e00128d9f63'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.628373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5e409bde534d79836c6e00128d9f63'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.630028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5e409bde534d79836c6e00128d9f63'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.642593 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43980c6a-77b9-4308-be57-c2970ff6bd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5e409bde534d79836c6e00128d9f63'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:21.672722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1306/2622] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:21 2022] DELETE /identity/v3/users/3e5e409bde534d79836c6e00128d9f63 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:21.979875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:21.982069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:22.002930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7c410-b391-4fb6-bbdc-57f22d033cd2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:22.088358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:22.089065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.089425 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.089899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] PATH_INFO: `/v3/projects/89082242e4fa4215939775ba21bf7b5b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.092049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89082242e4fa4215939775ba21bf7b5b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:22.094048 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:22.147113 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89082242e4fa4215939775ba21bf7b5b', 'request_id': 'req-3378c83b-21f7-417d-9405-7650f24642f5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:22.154317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89082242e4fa4215939775ba21bf7b5b', 'request_id': 'req-3378c83b-21f7-417d-9405-7650f24642f5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:22.163149 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89082242e4fa4215939775ba21bf7b5b', 'request_id': 'req-3378c83b-21f7-417d-9405-7650f24642f5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:22.174816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] The token cache is being invalidate because project 89082242e4fa4215939775ba21bf7b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:22.175099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:22.175766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3378c83b-21f7-417d-9405-7650f24642f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:22.177305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1317/2623] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:21 2022] DELETE /identity/v3/projects/89082242e4fa4215939775ba21bf7b5b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:22.182825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851efbcf-2970-4974-a8d9-90493405687b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.183422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851efbcf-2970-4974-a8d9-90493405687b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.183422 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851efbcf-2970-4974-a8d9-90493405687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.204408 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-851efbcf-2970-4974-a8d9-90493405687b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:22.205644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-851efbcf-2970-4974-a8d9-90493405687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:22.267776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1307/2624] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:22.276478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84802c4d-433a-47d8-abbd-9034efc22e2f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.276773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84802c4d-433a-47d8-abbd-9034efc22e2f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.277063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84802c4d-433a-47d8-abbd-9034efc22e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.315036 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-84802c4d-433a-47d8-abbd-9034efc22e2f None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:22.317213 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-84802c4d-433a-47d8-abbd-9034efc22e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:22.329706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1318/2625] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:22.334248 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851efbcf-2970-4974-a8d9-90493405687b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:22.339509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:22.345431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851efbcf-2970-4974-a8d9-90493405687b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:22.352544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:22.353212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.353758 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.354249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.355171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:22.355480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:22.357234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:22.370091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1308/2626] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:10:22.375345 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84802c4d-433a-47d8-abbd-9034efc22e2f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:22.385212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84802c4d-433a-47d8-abbd-9034efc22e2f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:22.390881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:22.391503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.391824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.392162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.392840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:22.394776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:22.425022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1319/2627] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:22 2022] POST /identity/v3/projects => generated 382 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:22.429280 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:22.440026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a2ea-bfb7-49c2-814d-7be4f24bbf6f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:22.499448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:22.500263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.500594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.500883 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.501585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:22.505022 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:22.530754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1309/2628] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:22 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:22.534793 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:22.546064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cf49b-3236-4e2c-a006-c9186e5f3e2f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:22.550719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:22.551406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.551642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.551913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.552615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:22.554250 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:22.694439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1320/2629] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:22 2022] GET /identity/v3/roles => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:22.698736 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:22.709570 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88455e32-d3fd-4825-8e19-b403355e1def admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:22.714505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5168-0a1c-4611-b997-73cb39440646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:22.715144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5168-0a1c-4611-b997-73cb39440646 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.715428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5168-0a1c-4611-b997-73cb39440646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.715725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5168-0a1c-4611-b997-73cb39440646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.716584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a5168-0a1c-4611-b997-73cb39440646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:22.718195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a5168-0a1c-4611-b997-73cb39440646 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:22.730924 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1310/2630] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:22 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:22.735909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:22.747530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa4ff7-741a-4302-aa1e-2318c4c06e7f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:22.753217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:22.753890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.754180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.754487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] PATH_INFO: `/v3/projects/6fef3a6cfe00458dad6d21be28f71163/users/aa66f4b7f16947daa3321f3fbc489a06/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.773253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fef3a6cfe00458dad6d21be28f71163, user_id=aa66f4b7f16947daa3321f3fbc489a06, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:22.776015 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:22.785627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:22.796791 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1321/2631] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:22 2022] PUT /identity/v3/projects/6fef3a6cfe00458dad6d21be28f71163/users/aa66f4b7f16947daa3321f3fbc489a06/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:22.808897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b20b-d282-43aa-9d7e-5139026121e9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:22.809190 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b20b-d282-43aa-9d7e-5139026121e9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:22.812848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2b20b-d282-43aa-9d7e-5139026121e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:22.842102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b1f2b20b-d282-43aa-9d7e-5139026121e9 None None] MFA Rules not processed for user `aa66f4b7f16947daa3321f3fbc489a06`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:22.843387 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1f2b20b-d282-43aa-9d7e-5139026121e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:22.929113 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1311/2632] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:22.937898 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.040069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358933-e242-4cfa-89c1-256ca29a12db admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.047101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.048057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.048509 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.049026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.049993 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.053460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.093079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1322/2633] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:22 2022] POST /identity/v3/projects => generated 382 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:23.098205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b20b-d282-43aa-9d7e-5139026121e9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.115572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2b20b-d282-43aa-9d7e-5139026121e9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.194084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:23.205573 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.206440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.206840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.207131 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.208184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.210169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.237774 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1312/2634] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:23 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:23.242490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.254468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946efa2a-7b0c-45df-b971-9ef6311a0c83 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.259562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.260192 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.260468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.260738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.261438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.263219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.274383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1323/2635] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:23 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:23.279193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.294315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339322f-b218-44f4-8031-a0c08014dfc9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.301473 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.302326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.302760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.303216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] PATH_INFO: `/v3/projects/c490b467e1ed482cb240ce569697c760/users/050ef12bbd334d33abcb92d76828ae30/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.313669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.315571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:23.319914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c490b467e1ed482cb240ce569697c760, user_id=050ef12bbd334d33abcb92d76828ae30, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.322656 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.329513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6247-83d6-4562-8398-a318469bccf1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.335981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.336693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1313/2636] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:23 2022] PUT /identity/v3/projects/c490b467e1ed482cb240ce569697c760/users/050ef12bbd334d33abcb92d76828ae30/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:23.336892 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.337321 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.337845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] PATH_INFO: `/v3/users/0ba59d4746354763b8b39b48c54507e3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.339545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba59d4746354763b8b39b48c54507e3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.341503 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.342776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.422727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba59d4746354763b8b39b48c54507e3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:23.428287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b03b3-4a09-438f-9697-670130e061eb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.435913 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba59d4746354763b8b39b48c54507e3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:23.436109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.437080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.437477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.437743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.438487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.440238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.450489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba59d4746354763b8b39b48c54507e3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:23.451543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1314/2637] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:23 2022] GET /identity/v3/roles => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:23.456103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba59d4746354763b8b39b48c54507e3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:23.456103 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1f95527d-9bf2-4937-8d74-f95920779af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba59d4746354763b8b39b48c54507e3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:23.457033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.458837 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:23.469544 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1324/2638] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:23 2022] DELETE /identity/v3/users/0ba59d4746354763b8b39b48c54507e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:23.473454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cbb64-e9bd-4229-8106-746d80f75a1b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.475126 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.475567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.475966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.497212 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:23.498508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:23.545339 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef4bd-4804-49dd-9ad7-7d995376d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.546010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef4bd-4804-49dd-9ad7-7d995376d595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.546393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef4bd-4804-49dd-9ad7-7d995376d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.546732 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef4bd-4804-49dd-9ad7-7d995376d595 admin admin] PATH_INFO: `/v3/projects/c490b467e1ed482cb240ce569697c760/users/050ef12bbd334d33abcb92d76828ae30/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.549529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ef4bd-4804-49dd-9ad7-7d995376d595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c490b467e1ed482cb240ce569697c760, user_id=050ef12bbd334d33abcb92d76828ae30, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.551693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:23.553034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ef4bd-4804-49dd-9ad7-7d995376d595 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.569124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1315/2639] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:23 2022] PUT /identity/v3/projects/c490b467e1ed482cb240ce569697c760/users/050ef12bbd334d33abcb92d76828ae30/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:23.576871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1325/2640] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:23.582035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.582368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.582653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.588031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.589768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:23.615105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] MFA Rules not processed for user `050ef12bbd334d33abcb92d76828ae30`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:23.616462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:23.656366 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acd28b-c483-4e80-b0ad-455ebd0e8727 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.672810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:23.708605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1316/2641] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:23.723572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:23.725195 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:23.752108 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.752740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.753029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.753314 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.791684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464d3ad-49d0-4163-9188-8b2ef141d708 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:23.795485 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:23.796047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:23.796330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:23.796606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:23.807160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.810651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.819549 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1317/2642] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:23.826650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:23.828094 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:23.837999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1326/2643] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:24.165622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:24.167191 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:24.183803 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb95e-6d99-4eb7-a081-1d06338a58e7 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:24.189875 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:24.190559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:24.190849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:24.191122 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] PATH_INFO: `/v3/projects/c43fc2a6a46c495d9a73d5563ffaa3ba` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:24.193074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43fc2a6a46c495d9a73d5563ffaa3ba)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:24.195244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:24.241383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:24.246103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43fc2a6a46c495d9a73d5563ffaa3ba', 'request_id': 'req-233f6d36-3cef-4c82-b98d-5afebc626128'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.252062 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecbeeb-bd2e-4241-b6a3-3bdfe12c2d29 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:24.253359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43fc2a6a46c495d9a73d5563ffaa3ba', 'request_id': 'req-233f6d36-3cef-4c82-b98d-5afebc626128'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.261896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43fc2a6a46c495d9a73d5563ffaa3ba', 'request_id': 'req-233f6d36-3cef-4c82-b98d-5afebc626128'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.274033 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] The token cache is being invalidate because project c43fc2a6a46c495d9a73d5563ffaa3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:24.274366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.275329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.276882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1318/2644] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:24 2022] DELETE /identity/v3/projects/c43fc2a6a46c495d9a73d5563ffaa3ba => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:24.281446 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:24.283099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:24.305272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:24.320958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:24.322027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:24.322572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:24.322984 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] PATH_INFO: `/v3/users/aa66f4b7f16947daa3321f3fbc489a06` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:24.325114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa66f4b7f16947daa3321f3fbc489a06)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:24.328513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:24.355915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f6d36-3cef-4c82-b98d-5afebc626128 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:24.361336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:24.361992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:24.362364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:24.362646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] PATH_INFO: `/v3/users/441843d9bcdc4b808ce782cd49584645` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:24.363836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] RBAC: Authorizing `identity:delete_user(user_id=441843d9bcdc4b808ce782cd49584645)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:24.365813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:24.371972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:24.395258 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa66f4b7f16947daa3321f3fbc489a06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.405259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa66f4b7f16947daa3321f3fbc489a06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.421776 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa66f4b7f16947daa3321f3fbc489a06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.422079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441843d9bcdc4b808ce782cd49584645'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.423273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa66f4b7f16947daa3321f3fbc489a06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.424101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-139f9100-758f-4f07-86c7-072a835294d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa66f4b7f16947daa3321f3fbc489a06'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.431340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441843d9bcdc4b808ce782cd49584645'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.432256 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441843d9bcdc4b808ce782cd49584645'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.432961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441843d9bcdc4b808ce782cd49584645'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.444221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441843d9bcdc4b808ce782cd49584645'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:24.447956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1327/2645] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:24 2022] DELETE /identity/v3/users/aa66f4b7f16947daa3321f3fbc489a06 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:24.452696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:24.453122 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:24.453487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:24.475717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1319/2646] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:24 2022] DELETE /identity/v3/users/441843d9bcdc4b808ce782cd49584645 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:24.475986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:24.477551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:24.562466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1328/2647] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:24.573776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:24.576035 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:24.645821 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed885f-77da-4e5f-8522-4e92f577686f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:24.650253 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:24.650990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:24.651305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:24.651702 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:24.663094 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:24.664591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:24.676729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1320/2648] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:24.879579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:24.882446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:24.906356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280598b7-4315-4656-969e-47df2b5f1aff None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:24.915009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:24.916503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:24.917081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:24.917806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] PATH_INFO: `/v3/projects/fc0273b4270c4504b5f550e74a100a23` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:24.921218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0273b4270c4504b5f550e74a100a23)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:24.925521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:25.008173 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0273b4270c4504b5f550e74a100a23', 'request_id': 'req-c000b410-cd8f-4b73-ad41-729d05a9b078'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.018573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0273b4270c4504b5f550e74a100a23', 'request_id': 'req-c000b410-cd8f-4b73-ad41-729d05a9b078'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.032558 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0273b4270c4504b5f550e74a100a23', 'request_id': 'req-c000b410-cd8f-4b73-ad41-729d05a9b078'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.043575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:25.054003 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] The token cache is being invalidate because project fc0273b4270c4504b5f550e74a100a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:25.055520 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.057010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.059288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1329/2649] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:24 2022] DELETE /identity/v3/projects/fc0273b4270c4504b5f550e74a100a23 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:25.064157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:25.088010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe39ba1-64f0-4ca4-8e16-67858e7e5399 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:25.141532 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:25.143273 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:25.188852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:25.189910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:25.190402 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:25.190850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] PATH_INFO: `/v3/users/a9b8de60cd2e4d798b4d4819e055522a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:25.192899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b8de60cd2e4d798b4d4819e055522a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:25.196345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:25.254028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:25.261517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000b410-cd8f-4b73-ad41-729d05a9b078 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:25.267133 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:25.267919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:25.268617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:25.268617 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] PATH_INFO: `/v3/projects/6fef3a6cfe00458dad6d21be28f71163` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:25.270146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fef3a6cfe00458dad6d21be28f71163)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:25.276820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:25.291674 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b8de60cd2e4d798b4d4819e055522a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.314139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b8de60cd2e4d798b4d4819e055522a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.314139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b8de60cd2e4d798b4d4819e055522a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.314139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b8de60cd2e4d798b4d4819e055522a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.323458 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b8de60cd2e4d798b4d4819e055522a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.351761 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1321/2650] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:25 2022] DELETE /identity/v3/users/a9b8de60cd2e4d798b4d4819e055522a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:25.353811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fef3a6cfe00458dad6d21be28f71163', 'request_id': 'req-c9946b77-41c0-4f93-b7f5-2760ede12542'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.366572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fef3a6cfe00458dad6d21be28f71163', 'request_id': 'req-c9946b77-41c0-4f93-b7f5-2760ede12542'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.379302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fef3a6cfe00458dad6d21be28f71163', 'request_id': 'req-c9946b77-41c0-4f93-b7f5-2760ede12542'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.391287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] The token cache is being invalidate because project 6fef3a6cfe00458dad6d21be28f71163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:25.391556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.392231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.393768 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1330/2651] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:25 2022] DELETE /identity/v3/projects/6fef3a6cfe00458dad6d21be28f71163 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:25.398237 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:25.400282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:25.516287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677f4e-40a2-4523-aa6d-f4083641820b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:25.522849 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:25.523511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:25.523795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:25.524074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] PATH_INFO: `/v3/users/050ef12bbd334d33abcb92d76828ae30` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:25.525371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050ef12bbd334d33abcb92d76828ae30)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:25.527356 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:25.592154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050ef12bbd334d33abcb92d76828ae30'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.600579 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050ef12bbd334d33abcb92d76828ae30'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.601314 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050ef12bbd334d33abcb92d76828ae30'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.602357 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050ef12bbd334d33abcb92d76828ae30'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.611182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0623ccd8-2165-4b21-b2ce-479d9de20f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050ef12bbd334d33abcb92d76828ae30'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:25.639451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1322/2652] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:25 2022] DELETE /identity/v3/users/050ef12bbd334d33abcb92d76828ae30 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:25.729724 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:25.731572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:25.818861 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9946b77-41c0-4f93-b7f5-2760ede12542 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:25.880736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:25.926992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:25.927954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:25.928381 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:25.928788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] PATH_INFO: `/v3/projects/70ab527786924ca4a3b811d6658d57eb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:25.930401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ab527786924ca4a3b811d6658d57eb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:25.932832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.010490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ab527786924ca4a3b811d6658d57eb', 'request_id': 'req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.022324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ab527786924ca4a3b811d6658d57eb', 'request_id': 'req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.035573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ab527786924ca4a3b811d6658d57eb', 'request_id': 'req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.052820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] The token cache is being invalidate because project 70ab527786924ca4a3b811d6658d57eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:26.053135 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.053856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.055709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1331/2653] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:25 2022] DELETE /identity/v3/projects/70ab527786924ca4a3b811d6658d57eb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:26.065038 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3693-b8b7-4e7e-94cc-09dd6f898c21 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.065571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3693-b8b7-4e7e-94cc-09dd6f898c21 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.066097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af3693-b8b7-4e7e-94cc-09dd6f898c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.092827 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.093128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-14af3693-b8b7-4e7e-94cc-09dd6f898c21 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:26.094472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14af3693-b8b7-4e7e-94cc-09dd6f898c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:26.094976 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:26.137904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:26.195584 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f892d7-9233-4f93-a1a2-8b59dd7b85f7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.202677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1323/2654] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:26.203553 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.204604 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.204914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.205210 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] PATH_INFO: `/v3/projects/c490b467e1ed482cb240ce569697c760` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.206609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c490b467e1ed482cb240ce569697c760)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.208653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.215701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5999-5d01-489a-af9e-7ecd9a5d077c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.216218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5999-5d01-489a-af9e-7ecd9a5d077c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.216861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5999-5d01-489a-af9e-7ecd9a5d077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.245268 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f79b5999-5d01-489a-af9e-7ecd9a5d077c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:26.247364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f79b5999-5d01-489a-af9e-7ecd9a5d077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:26.256350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1324/2655] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:26.263666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5999-5d01-489a-af9e-7ecd9a5d077c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.277184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5999-5d01-489a-af9e-7ecd9a5d077c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.277758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c490b467e1ed482cb240ce569697c760', 'request_id': 'req-4b2dff71-927d-4619-9f7a-62b022665f5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.286689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c490b467e1ed482cb240ce569697c760', 'request_id': 'req-4b2dff71-927d-4619-9f7a-62b022665f5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.297239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c490b467e1ed482cb240ce569697c760', 'request_id': 'req-4b2dff71-927d-4619-9f7a-62b022665f5e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.301334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:26.315201 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] The token cache is being invalidate because project c490b467e1ed482cb240ce569697c760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:26.316500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.318736 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4b2dff71-927d-4619-9f7a-62b022665f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:26.320496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1332/2656] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:26 2022] DELETE /identity/v3/projects/c490b467e1ed482cb240ce569697c760 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:26.326408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07190a-dcbc-472d-bbf1-d6f84fdce8bf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.326719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07190a-dcbc-472d-bbf1-d6f84fdce8bf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.327171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07190a-dcbc-472d-bbf1-d6f84fdce8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.349251 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-bf07190a-dcbc-472d-bbf1-d6f84fdce8bf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:26.350609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bf07190a-dcbc-472d-bbf1-d6f84fdce8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:26.357609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.358319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.358627 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.358925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.359665 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:26.360000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.361744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.376232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1325/2657] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:10:26.380974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.383005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:26.399259 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e56ec-0a42-40ad-9fa5-6e8a8904fa50 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.408373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.409393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.409898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.411155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.412454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.414776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.447582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1333/2658] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:26.454637 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d0e7-ad4c-4419-9cb2-eb889d8d47b8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.454944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d0e7-ad4c-4419-9cb2-eb889d8d47b8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.455236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d0e7-ad4c-4419-9cb2-eb889d8d47b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.458021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1326/2659] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/projects => generated 402 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:26.463305 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.487080 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9542d0e7-ad4c-4419-9cb2-eb889d8d47b8 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:26.488593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9542d0e7-ad4c-4419-9cb2-eb889d8d47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:26.560745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b9de1-b939-4366-a4b4-f1f8979ce108 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.564807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1334/2660] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:26.568196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.569225 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.569513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d0e7-ad4c-4419-9cb2-eb889d8d47b8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.569688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.569841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.570841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.573062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.580222 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d0e7-ad4c-4419-9cb2-eb889d8d47b8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.585921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.586788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.587069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.587353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.588105 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:26.588421 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.590503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.599789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1327/2661] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/users => generated 302 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:26.604238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.605701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1335/2662] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:10:26.612024 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.617218 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3ed9-1a1f-422b-9f71-42fc39ad31c4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.622599 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.623252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.623546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.623828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.624577 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.628114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.632364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09629fa2-0acf-42df-91ca-afabb862aea6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.641332 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.642495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.643018 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.643526 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.645502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1328/2663] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:26.645887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.650324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.650841 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.661917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b22e5-937e-4403-b310-2246611c3c44 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.669149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.670186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.670704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.671338 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.672554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.675196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.678800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:26.699153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1336/2664] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/projects => generated 374 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:26.699430 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1329/2665] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:26.700744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.702211 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.714562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1641-9a4c-4d87-9561-952df3d9fe5c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.794226 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:26.796067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.796827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.797141 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.797429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.798142 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.800317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.800453 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0741097-8647-4da0-9e0f-502d83ca1ac5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.810686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.812255 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.813162 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.813979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] PATH_INFO: `/v3/projects/10ecf4dfdcfc43e2b571119caaad2f6a/users/d82dd34dab134fa0983b530ddd4817da/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.831642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1330/2666] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:26.837649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.845917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ecf4dfdcfc43e2b571119caaad2f6a, user_id=d82dd34dab134fa0983b530ddd4817da, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.851855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.857724 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973494e-0b70-422f-a272-4a206e89b351 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:26.866238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae36769-d363-4297-8853-b21d3a892a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:26.867621 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36769-d363-4297-8853-b21d3a892a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.868365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36769-d363-4297-8853-b21d3a892a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.868973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36769-d363-4297-8853-b21d3a892a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.869931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae36769-d363-4297-8853-b21d3a892a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:26.872069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae36769-d363-4297-8853-b21d3a892a38 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:26.879300 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1337/2667] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:26 2022] PUT /identity/v3/projects/10ecf4dfdcfc43e2b571119caaad2f6a/users/d82dd34dab134fa0983b530ddd4817da/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:26.887585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1331/2668] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:26.901107 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:26.908518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b826b-bdf0-42f3-8b73-0fa9def68a37 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:26.909063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b826b-bdf0-42f3-8b73-0fa9def68a37 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:26.909520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b826b-bdf0-42f3-8b73-0fa9def68a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:26.960001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c30b826b-bdf0-42f3-8b73-0fa9def68a37 None None] MFA Rules not processed for user `d82dd34dab134fa0983b530ddd4817da`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:26.961497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c30b826b-bdf0-42f3-8b73-0fa9def68a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:27.004289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cac78-038e-42bd-81f6-777d5bf3e329 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.013416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.014413 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.014857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.015349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.016578 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.019337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.037888 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1338/2669] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:26 2022] GET /identity/v3/roles => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:27.042992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.060548 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2b67b-0445-4143-973f-2f4625dba5fc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.067757 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee6aa9-c11b-4fa2-96f9-f177f01c17cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.068562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee6aa9-c11b-4fa2-96f9-f177f01c17cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.068935 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee6aa9-c11b-4fa2-96f9-f177f01c17cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.069301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee6aa9-c11b-4fa2-96f9-f177f01c17cf admin admin] PATH_INFO: `/v3/projects/fc42cd8ac70e40fc9f1ce4efc46db682/users/8a997907345b4a4cad3e4708e9f344a7/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.072576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1332/2670] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:27.077493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b826b-bdf0-42f3-8b73-0fa9def68a37 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.087828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee6aa9-c11b-4fa2-96f9-f177f01c17cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc42cd8ac70e40fc9f1ce4efc46db682, user_id=8a997907345b4a4cad3e4708e9f344a7, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.091433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee6aa9-c11b-4fa2-96f9-f177f01c17cf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.094114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b826b-bdf0-42f3-8b73-0fa9def68a37 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.102698 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.103663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.104101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.104562 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.105748 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.109432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.111246 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1339/2671] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:27 2022] PUT /identity/v3/projects/fc42cd8ac70e40fc9f1ce4efc46db682/users/8a997907345b4a4cad3e4708e9f344a7/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:27.117009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.117353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.117642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.138350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:27.139595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:27.160755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1333/2672] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:27 2022] POST /identity/v3/projects => generated 402 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:27.164872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.220660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:27.225788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1340/2673] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:27.235789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.238408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:27.239226 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2272a2-0ab7-45b5-8d7c-18afb42c3b7d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.245335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.245975 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.246255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.246619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.247287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.249212 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.274995 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1334/2674] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:27 2022] POST /identity/v3/users => generated 308 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:27.280741 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.292171 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300cc5-ada8-4053-b7a1-54e65066aaff admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.298484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.299109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.299390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.299662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.300362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.302000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.312827 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1335/2675] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:27 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:27.314677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560de63-b1b2-4470-9ff6-4a1e912f27b6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.317716 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.321765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:27.331744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42d055-d865-42ca-b455-d76f919e7a46 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.338127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.339435 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.339894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.340416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] PATH_INFO: `/v3/projects/f3d739434f3d471c8a5e540fe7d9bcd9/users/495733f9a83a4ffe8de7ca09037add26/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.364283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d739434f3d471c8a5e540fe7d9bcd9, user_id=495733f9a83a4ffe8de7ca09037add26, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.367042 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.384143 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1336/2676] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:27 2022] PUT /identity/v3/projects/f3d739434f3d471c8a5e540fe7d9bcd9/users/495733f9a83a4ffe8de7ca09037add26/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:27.388722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.393190 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.394217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.394731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.395202 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.412164 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.413612 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.424039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1341/2677] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:27.486978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a97492-89a0-4bc7-a8d7-f958adbd3afe admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.493246 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c22a-e5fc-4372-940c-a0ef3b685eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.493943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c22a-e5fc-4372-940c-a0ef3b685eff admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.494291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c22a-e5fc-4372-940c-a0ef3b685eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.494746 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c22a-e5fc-4372-940c-a0ef3b685eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.495647 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c22a-e5fc-4372-940c-a0ef3b685eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.497713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c22a-e5fc-4372-940c-a0ef3b685eff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.511616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1337/2678] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:27 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:27.516996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.535078 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a74d-f96d-4980-b5b7-a25a6baa52ed service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.543144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.544291 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.544789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.545252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] PATH_INFO: `/v3/projects/f3d739434f3d471c8a5e540fe7d9bcd9/users/495733f9a83a4ffe8de7ca09037add26/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.548655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d739434f3d471c8a5e540fe7d9bcd9, user_id=495733f9a83a4ffe8de7ca09037add26, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.553833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.572585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1342/2679] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:27 2022] PUT /identity/v3/projects/f3d739434f3d471c8a5e540fe7d9bcd9/users/495733f9a83a4ffe8de7ca09037add26/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:27.593502 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d5bf-cf49-4b58-940a-568dc28fb90f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.593974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d5bf-cf49-4b58-940a-568dc28fb90f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.594496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d5bf-cf49-4b58-940a-568dc28fb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.641777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8f21d5bf-cf49-4b58-940a-568dc28fb90f None None] MFA Rules not processed for user `495733f9a83a4ffe8de7ca09037add26`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:27.643955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8f21d5bf-cf49-4b58-940a-568dc28fb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:27.752581 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1338/2680] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:27.768885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:27.771650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:27.900821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c11bf-85de-4a1c-a85b-84d346351d00 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:27.910019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e7f36-8c13-4651-8f03-51adc9b43b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:27.911597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7f36-8c13-4651-8f03-51adc9b43b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:27.912071 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7f36-8c13-4651-8f03-51adc9b43b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:27.912537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e7f36-8c13-4651-8f03-51adc9b43b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:27.927377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e7f36-8c13-4651-8f03-51adc9b43b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:27.928825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e7f36-8c13-4651-8f03-51adc9b43b6e service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:27.942688 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1343/2681] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:28.036468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d5bf-cf49-4b58-940a-568dc28fb90f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:28.046591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d5bf-cf49-4b58-940a-568dc28fb90f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:28.051508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:28.052219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:28.052667 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:28.053102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:28.073592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:28.139449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:28.140903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:28.150588 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1339/2682] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:32.953386 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004d2e-a070-4df1-b5fa-c2fdc05ddbac None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:32.953856 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004d2e-a070-4df1-b5fa-c2fdc05ddbac None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:32.954110 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39004d2e-a070-4df1-b5fa-c2fdc05ddbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:33.060198 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-39004d2e-a070-4df1-b5fa-c2fdc05ddbac None None] MFA Rules not processed for user `8a997907345b4a4cad3e4708e9f344a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:33.062309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-39004d2e-a070-4df1-b5fa-c2fdc05ddbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:33.156675 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:33.225904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1344/2683] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:33.232943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004d2e-a070-4df1-b5fa-c2fdc05ddbac None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:33.295347 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ed079-9608-40d0-95fc-764256a2631a service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:33.301183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:33.302098 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:33.302488 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:33.302845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] PATH_INFO: `/v3/users/d82dd34dab134fa0983b530ddd4817da` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:33.304337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82dd34dab134fa0983b530ddd4817da)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:33.304742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:33.311323 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:33.374626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39004d2e-a070-4df1-b5fa-c2fdc05ddbac None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:33.390787 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:33.392243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:33.392716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:33.393145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:33.394790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:33.400745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:33.473664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1345/2684] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:33 2022] POST /identity/v3/projects => generated 374 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:33.480184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:33.602714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da0c8b-af1d-4960-aac4-eb9458b46e38 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:33.611676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:33.612322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:33.612654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:33.612930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:33.613056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82dd34dab134fa0983b530ddd4817da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:33.613642 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:33.616551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:33.630330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82dd34dab134fa0983b530ddd4817da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:33.633157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82dd34dab134fa0983b530ddd4817da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:33.649163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82dd34dab134fa0983b530ddd4817da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:33.665840 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cdb606d4-f22e-4ace-b9d4-23f94a33203e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82dd34dab134fa0983b530ddd4817da'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:33.676717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1346/2685] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:33 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:33.682773 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:33.691639 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:33.753991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1340/2686] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:33 2022] DELETE /identity/v3/users/d82dd34dab134fa0983b530ddd4817da => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:33.759111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:33.759793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:33.760193 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:33.762422 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5286f0-6ad6-4c57-a686-5947155fd29d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:33.817105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:33.821556 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:33.871252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:33.871836 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:33.872124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:33.872411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:33.874299 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:33.876513 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:33.888809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:33.900406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1347/2687] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:33 2022] GET /identity/v3/roles => generated 1427 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:33.912125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:33.930634 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a10d-0803-469a-aaf1-c2423412448b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:33.937017 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:33.938887 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:33.939594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:33.940188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] PATH_INFO: `/v3/projects/7771895c1a7b4e4183dbb2da92a898de/users/f04f69e052bf491ea21cc497485a6cfa/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:33.957291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1341/2688] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:33.966378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7771895c1a7b4e4183dbb2da92a898de, user_id=f04f69e052bf491ea21cc497485a6cfa, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:33.970382 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:33.981775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:33.983407 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:34.008593 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1348/2689] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:33 2022] PUT /identity/v3/projects/7771895c1a7b4e4183dbb2da92a898de/users/f04f69e052bf491ea21cc497485a6cfa/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:34.013749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:34.073862 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:34.079628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8233-52bc-4617-b9a3-e4f5f3e6b4b0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:34.177741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0c8c7-04a6-4d75-8956-570150f1f5f7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:34.186810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:34.188275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:34.188625 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:34.189034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:34.190123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:34.192136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:34.205201 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:34.206121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1349/2690] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:34 2022] GET /identity/v3/roles => generated 1427 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:34.206299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:34.206299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:34.206557 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:34.210682 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:34.229120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b4277-8153-4617-80b2-35bb661e5d00 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:34.231778 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:34.235354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:34.244252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:34.244951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:34.245233 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:34.245510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] PATH_INFO: `/v3/projects/7771895c1a7b4e4183dbb2da92a898de/users/f04f69e052bf491ea21cc497485a6cfa/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:34.249545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7771895c1a7b4e4183dbb2da92a898de, user_id=f04f69e052bf491ea21cc497485a6cfa, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:34.256169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:34.264565 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1342/2691] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:34.303306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1350/2692] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:34 2022] PUT /identity/v3/projects/7771895c1a7b4e4183dbb2da92a898de/users/f04f69e052bf491ea21cc497485a6cfa/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:34.929135 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:34.930662 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:34.956851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08097b-bde7-473e-93b6-2b4cb52762f2 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:35.089874 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:35.091125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:35.091420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:35.091696 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] PATH_INFO: `/v3/projects/10ecf4dfdcfc43e2b571119caaad2f6a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:35.092988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ecf4dfdcfc43e2b571119caaad2f6a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:35.095039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:35.166051 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:35.178245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ecf4dfdcfc43e2b571119caaad2f6a', 'request_id': 'req-da0cbb57-142c-405a-b8e7-5a28298ab06c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.193640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ecf4dfdcfc43e2b571119caaad2f6a', 'request_id': 'req-da0cbb57-142c-405a-b8e7-5a28298ab06c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.207223 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ecf4dfdcfc43e2b571119caaad2f6a', 'request_id': 'req-da0cbb57-142c-405a-b8e7-5a28298ab06c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.225966 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] The token cache is being invalidate because project 10ecf4dfdcfc43e2b571119caaad2f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:35.226329 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.227123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.229528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1343/2693] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:34 2022] DELETE /identity/v3/projects/10ecf4dfdcfc43e2b571119caaad2f6a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:35.234206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:35.236044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:35.254775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd33a57-f999-4848-b5d7-a02fe1c3a465 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:35.387810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:35.388670 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:35.388966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:35.389364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] PATH_INFO: `/v3/users/495733f9a83a4ffe8de7ca09037add26` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:35.392315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495733f9a83a4ffe8de7ca09037add26)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:35.393853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:35.478325 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495733f9a83a4ffe8de7ca09037add26'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.505082 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495733f9a83a4ffe8de7ca09037add26'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.525298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495733f9a83a4ffe8de7ca09037add26'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.526328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495733f9a83a4ffe8de7ca09037add26'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.530350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29d478a7-17cc-436d-853e-3d28c9d79dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495733f9a83a4ffe8de7ca09037add26'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:35.548629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1351/2694] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:35 2022] DELETE /identity/v3/users/495733f9a83a4ffe8de7ca09037add26 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:36.681585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:36.725815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cbb57-142c-405a-b8e7-5a28298ab06c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:36.833060 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:36.834863 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:36.835350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:36.835795 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] PATH_INFO: `/v3/projects/f3d739434f3d471c8a5e540fe7d9bcd9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:36.837331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d739434f3d471c8a5e540fe7d9bcd9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:36.840568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:36.941247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d739434f3d471c8a5e540fe7d9bcd9', 'request_id': 'req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:36.951150 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d739434f3d471c8a5e540fe7d9bcd9', 'request_id': 'req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:36.979028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d739434f3d471c8a5e540fe7d9bcd9', 'request_id': 'req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:37.018344 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] The token cache is being invalidate because project f3d739434f3d471c8a5e540fe7d9bcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:37.019024 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:37.022750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd8e9a9d-e2fb-4c2e-8cea-6c7462691a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:37.024699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1344/2695] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:36 2022] DELETE /identity/v3/projects/f3d739434f3d471c8a5e540fe7d9bcd9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:37.030869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf97b3-3632-46b9-b9fc-3a61342246d4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.031508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf97b3-3632-46b9-b9fc-3a61342246d4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.031508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf97b3-3632-46b9-b9fc-3a61342246d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.081150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-faaf97b3-3632-46b9-b9fc-3a61342246d4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:37.082475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-faaf97b3-3632-46b9-b9fc-3a61342246d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:37.111751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:37.209524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1352/2696] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:37.218165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57edc-9461-4e8d-911a-bff24dfe80a2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.218497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57edc-9461-4e8d-911a-bff24dfe80a2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.218793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57edc-9461-4e8d-911a-bff24dfe80a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.259227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c3e57edc-9461-4e8d-911a-bff24dfe80a2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:37.270777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c3e57edc-9461-4e8d-911a-bff24dfe80a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:37.282440 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1345/2697] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:37.288197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf97b3-3632-46b9-b9fc-3a61342246d4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:37.330051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf97b3-3632-46b9-b9fc-3a61342246d4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:37.341801 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:37.343100 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.343698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.356146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.360330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:37.360330 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:37.389645 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:37.452403 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1353/2698] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:10:37.458080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57edc-9461-4e8d-911a-bff24dfe80a2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:37.470787 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57edc-9461-4e8d-911a-bff24dfe80a2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:37.478506 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:37.479584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.480101 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.480982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.481834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:37.484555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:37.565161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1346/2699] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:37 2022] POST /identity/v3/projects => generated 384 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:37.570708 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:37.589293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e87cb8-a3b5-4f69-b5e9-e0c381a614f9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:37.718709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:37.719570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.719982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.720367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.721326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:37.725947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:37.764200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1354/2700] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:37 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:37.769793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:37.782686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c57ec-d2b6-493f-a360-4108decccb2e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:37.790126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:37.791331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.791897 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.792465 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.796653 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:37.797826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:37.818328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1347/2701] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:37 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:37.821626 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:37.833500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85232a-746c-482f-b9c9-11f99c0fc4aa admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:37.838814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496312b3-8135-4dec-871a-17d9ad2eb60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:37.839675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496312b3-8135-4dec-871a-17d9ad2eb60b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.847124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496312b3-8135-4dec-871a-17d9ad2eb60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.847124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496312b3-8135-4dec-871a-17d9ad2eb60b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.847124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496312b3-8135-4dec-871a-17d9ad2eb60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:37.847124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496312b3-8135-4dec-871a-17d9ad2eb60b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:37.877187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1355/2702] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:37 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:37.882330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:37.900844 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092b859-3962-4291-a413-03ed9014a7dd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:37.906386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:37.907084 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.907509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.907789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] PATH_INFO: `/v3/projects/6239da7152c041edb645a07a12179e7b/users/b74d7570df8947abbe99d5532f2313d3/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:37.946857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6239da7152c041edb645a07a12179e7b, user_id=b74d7570df8947abbe99d5532f2313d3, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:37.952718 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:37.953351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:37.976973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1348/2703] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:37 2022] PUT /identity/v3/projects/6239da7152c041edb645a07a12179e7b/users/b74d7570df8947abbe99d5532f2313d3/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:37.995938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8866a-bb5c-4aff-93e0-0830c9171c14 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:37.997077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8866a-bb5c-4aff-93e0-0830c9171c14 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:37.997259 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8866a-bb5c-4aff-93e0-0830c9171c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:38.064660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3cb8866a-bb5c-4aff-93e0-0830c9171c14 None None] MFA Rules not processed for user `b74d7570df8947abbe99d5532f2313d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:38.067054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3cb8866a-bb5c-4aff-93e0-0830c9171c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:38.227576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1356/2704] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:38.232956 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:38.376585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b2a2-5c45-4bf3-b5f3-cb97edfea100 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:38.388415 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:38.389416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:38.389937 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:38.390552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:38.391695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:38.396533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:38.455532 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1349/2705] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:38 2022] POST /identity/v3/projects => generated 382 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:38.459016 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8866a-bb5c-4aff-93e0-0830c9171c14 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:38.473675 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8866a-bb5c-4aff-93e0-0830c9171c14 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:38.488994 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:38.587469 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:38.588960 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:38.589799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:38.590796 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:38.593342 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:38.596372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:38.664983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1357/2706] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:38 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:38.668957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:38.689137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e2a73-1a23-4090-9a3f-ef9f67837ecb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:38.698409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:38.699811 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:38.700386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:38.701186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:38.701804 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:38.703713 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:38.725221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1350/2707] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:38 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:38.726837 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:38.741349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6909c-e203-4805-af64-5b1e53a8bc4d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:38.745511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:38.746533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:38.746823 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:38.747105 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] PATH_INFO: `/v3/projects/04f436d864ab4a109755acc6ce16d51f/users/9cf5e6a2d3f24134895f992593364a69/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:38.781845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f436d864ab4a109755acc6ce16d51f, user_id=9cf5e6a2d3f24134895f992593364a69, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:38.786473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:38.820504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1358/2708] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:38 2022] PUT /identity/v3/projects/04f436d864ab4a109755acc6ce16d51f/users/9cf5e6a2d3f24134895f992593364a69/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:38.825561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:38.843813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38695a-bd4f-4761-b6c1-0a198d01667a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:38.988694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d69db-0ada-46e8-93cb-361187b761e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:38.990233 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d69db-0ada-46e8-93cb-361187b761e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:38.990717 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d69db-0ada-46e8-93cb-361187b761e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:38.991179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d69db-0ada-46e8-93cb-361187b761e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:38.992587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d69db-0ada-46e8-93cb-361187b761e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:38.996000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d69db-0ada-46e8-93cb-361187b761e4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:39.029021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1351/2709] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:38 2022] GET /identity/v3/roles => generated 1427 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:39.029406 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:39.049101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee0e65-57fa-421b-b182-3027d8cb01b5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:39.057480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:39.058514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:39.059437 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:39.060120 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] PATH_INFO: `/v3/projects/04f436d864ab4a109755acc6ce16d51f/users/9cf5e6a2d3f24134895f992593364a69/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:39.062907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f436d864ab4a109755acc6ce16d51f, user_id=9cf5e6a2d3f24134895f992593364a69, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:39.065927 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:39.082336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1359/2710] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:39 2022] PUT /identity/v3/projects/04f436d864ab4a109755acc6ce16d51f/users/9cf5e6a2d3f24134895f992593364a69/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:39.095896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111909-06ce-41e2-a0c2-e620b5706809 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:39.096119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111909-06ce-41e2-a0c2-e620b5706809 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:39.096326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8111909-06ce-41e2-a0c2-e620b5706809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:39.142023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c8111909-06ce-41e2-a0c2-e620b5706809 None None] MFA Rules not processed for user `9cf5e6a2d3f24134895f992593364a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:39.144351 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c8111909-06ce-41e2-a0c2-e620b5706809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:39.290887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:39.366571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1352/2711] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:39.381631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:39.383605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:39.555678 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5e6b0-a945-422b-b793-4505e7287b42 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:39.562146 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:39.563355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:39.563905 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:39.564245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:39.587217 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:39.589012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:39.620632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1360/2712] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:39.806671 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111909-06ce-41e2-a0c2-e620b5706809 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:39.820944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8111909-06ce-41e2-a0c2-e620b5706809 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:39.830909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fc415-2e20-4033-9b55-80f5fa4cf1d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:39.831904 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc415-2e20-4033-9b55-80f5fa4cf1d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:39.832066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc415-2e20-4033-9b55-80f5fa4cf1d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:39.832386 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc415-2e20-4033-9b55-80f5fa4cf1d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:39.954850 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fc415-2e20-4033-9b55-80f5fa4cf1d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:39.956974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fc415-2e20-4033-9b55-80f5fa4cf1d8 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:39.973857 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1353/2713] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:40.179446 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:40.194909 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:40.395746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba4ed-5623-49cd-8daa-295847480dda service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:40.409356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:40.409840 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:40.410123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:40.410433 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:40.415729 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:40.475734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:40.576692 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:40.580853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:40.622312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1361/2714] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:41.481652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162d11-c4da-45f9-a15a-8066625ca4ab None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:41.482245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162d11-c4da-45f9-a15a-8066625ca4ab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:41.482245 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162d11-c4da-45f9-a15a-8066625ca4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:41.518798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1c162d11-c4da-45f9-a15a-8066625ca4ab None None] MFA Rules not processed for user `f04f69e052bf491ea21cc497485a6cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:41.519964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1c162d11-c4da-45f9-a15a-8066625ca4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:41.633592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1354/2715] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:41.649286 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:41.651017 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:41.780996 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cdf7f-01e7-4698-aaf9-eaf3b4cfae9a service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:41.804599 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02fd54-4dca-45ca-aa2c-caae9f3bca32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:41.805256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02fd54-4dca-45ca-aa2c-caae9f3bca32 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:41.805536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02fd54-4dca-45ca-aa2c-caae9f3bca32 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:41.805807 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02fd54-4dca-45ca-aa2c-caae9f3bca32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:41.807870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5c02fd54-4dca-45ca-aa2c-caae9f3bca32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:41.912557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02fd54-4dca-45ca-aa2c-caae9f3bca32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:41.914334 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02fd54-4dca-45ca-aa2c-caae9f3bca32 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:41.927010 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1362/2716] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:43.145693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c162d11-c4da-45f9-a15a-8066625ca4ab None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:43.160066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c162d11-c4da-45f9-a15a-8066625ca4ab None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:43.168766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:43.169899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:43.170447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:43.170954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] PATH_INFO: `/v3/users/b74d7570df8947abbe99d5532f2313d3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:43.173367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74d7570df8947abbe99d5532f2313d3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:43.176980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:43.379288 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74d7570df8947abbe99d5532f2313d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:43.409133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74d7570df8947abbe99d5532f2313d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:43.415049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74d7570df8947abbe99d5532f2313d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:43.424512 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74d7570df8947abbe99d5532f2313d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:43.452878 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74d7570df8947abbe99d5532f2313d3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:43.471010 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:43.531510 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1355/2717] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:43 2022] DELETE /identity/v3/users/b74d7570df8947abbe99d5532f2313d3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:43.537966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b29d2-cfd1-49c4-aa9a-0401fbaa0db4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:43.537966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b29d2-cfd1-49c4-aa9a-0401fbaa0db4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:43.537966 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b29d2-cfd1-49c4-aa9a-0401fbaa0db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:43.590293 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9f9b29d2-cfd1-49c4-aa9a-0401fbaa0db4 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:43.598576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9f9b29d2-cfd1-49c4-aa9a-0401fbaa0db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:43.744329 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:43.770046 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1363/2718] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:43.811507 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:43.814513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:43.867023 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:43.867845 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:43.868401 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:43.920211 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] MFA Rules not processed for user `8a997907345b4a4cad3e4708e9f344a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:43.923354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:44.036566 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553342a-3f69-42ff-a58b-d6ef7566442c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:44.045839 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1364/2719] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:44.062513 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:44.063620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:44.064106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:44.064567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:44.093471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:44.095983 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:44.127205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1356/2720] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:44.916101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:44.917802 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:44.941591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd1ab-10a5-414d-8644-28a41a07229c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:44.963557 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:44.964814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:44.965408 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:44.969582 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] PATH_INFO: `/v3/projects/6239da7152c041edb645a07a12179e7b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:44.971855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6239da7152c041edb645a07a12179e7b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:44.973691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:45.075155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6239da7152c041edb645a07a12179e7b', 'request_id': 'req-ecd0a051-4850-4d4d-8ae8-a502ed414766'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.084577 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6239da7152c041edb645a07a12179e7b', 'request_id': 'req-ecd0a051-4850-4d4d-8ae8-a502ed414766'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.096013 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6239da7152c041edb645a07a12179e7b', 'request_id': 'req-ecd0a051-4850-4d4d-8ae8-a502ed414766'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.126359 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] The token cache is being invalidate because project 6239da7152c041edb645a07a12179e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:45.127128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.128734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.139317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1365/2721] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:44 2022] DELETE /identity/v3/projects/6239da7152c041edb645a07a12179e7b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:45.140571 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:45.152528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9356e7-b3d4-4158-b1cb-899260c49513 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:45.389762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:45.392909 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:45.393427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:45.393930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] PATH_INFO: `/v3/users/9cf5e6a2d3f24134895f992593364a69` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:45.397118 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf5e6a2d3f24134895f992593364a69)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:45.402851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:45.538617 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf5e6a2d3f24134895f992593364a69'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.583836 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf5e6a2d3f24134895f992593364a69'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.586047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf5e6a2d3f24134895f992593364a69'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.590846 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf5e6a2d3f24134895f992593364a69'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.610616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf5e6a2d3f24134895f992593364a69'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:45.656426 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1357/2722] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:45 2022] DELETE /identity/v3/users/9cf5e6a2d3f24134895f992593364a69 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:46.189409 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:46.193746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:46.222324 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a051-4850-4d4d-8ae8-a502ed414766 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:46.353825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:46.355753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:46.356323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:46.357416 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] PATH_INFO: `/v3/users/cc1712f30dcc4ff4b350c91c76f5a3f3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:46.359003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:46.362776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:46.364022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1712f30dcc4ff4b350c91c76f5a3f3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:46.367429 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:46.385209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f4402-fffb-4e99-894a-24177547afad admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:46.400755 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:46.402751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:46.403654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:46.404103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] PATH_INFO: `/v3/projects/04f436d864ab4a109755acc6ce16d51f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:46.405915 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f436d864ab4a109755acc6ce16d51f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:46.409767 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:46.413159 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:46.425459 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:46.475079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1712f30dcc4ff4b350c91c76f5a3f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.494567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1712f30dcc4ff4b350c91c76f5a3f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.523864 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f436d864ab4a109755acc6ce16d51f', 'request_id': 'req-5378c52f-3d68-4247-9178-a00d8a1697c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.526093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1712f30dcc4ff4b350c91c76f5a3f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.526951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1712f30dcc4ff4b350c91c76f5a3f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.527602 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-29447167-450c-4ae0-b9be-3e880384b659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1712f30dcc4ff4b350c91c76f5a3f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.542182 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f436d864ab4a109755acc6ce16d51f', 'request_id': 'req-5378c52f-3d68-4247-9178-a00d8a1697c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.546684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1366/2723] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:46 2022] DELETE /identity/v3/users/cc1712f30dcc4ff4b350c91c76f5a3f3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:46.561013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f436d864ab4a109755acc6ce16d51f', 'request_id': 'req-5378c52f-3d68-4247-9178-a00d8a1697c5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.586723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] The token cache is being invalidate because project 04f436d864ab4a109755acc6ce16d51f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:46.587099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.588168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5378c52f-3d68-4247-9178-a00d8a1697c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:46.591097 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1358/2724] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:46 2022] DELETE /identity/v3/projects/04f436d864ab4a109755acc6ce16d51f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:46.598104 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaa73e-0c6c-4def-8224-1a1136e7000e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:46.609706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaa73e-0c6c-4def-8224-1a1136e7000e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:46.609706 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaa73e-0c6c-4def-8224-1a1136e7000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:46.640106 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d3aaa73e-0c6c-4def-8224-1a1136e7000e None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:46.642183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d3aaa73e-0c6c-4def-8224-1a1136e7000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:46.801114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:46.802111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:46.802931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:46.808932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1367/2725] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:46.837963 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:46.840452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:46.854157 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1359/2726] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:46.861349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaa73e-0c6c-4def-8224-1a1136e7000e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:46.878220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaa73e-0c6c-4def-8224-1a1136e7000e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:46.885216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:46.886289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:46.887731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:46.888317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:46.890914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:46.891540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:46.893932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:46.907626 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:46.909327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:46.919629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1368/2727] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:10:46.924124 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:46.924942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0751f-e1fe-4bf2-9686-c5be9922d2c0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:46.934102 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:46.935262 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:46.935753 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:46.936261 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] PATH_INFO: `/v3/projects/32994118a4204798a11263b254c41b55` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:46.939355 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32994118a4204798a11263b254c41b55)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:46.943898 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:46.951658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690b55e-de15-4c49-8aef-bad63a9ea8cc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:46.959085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:46.959866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:46.960232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:46.960427 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:46.961853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:46.966134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.018172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1369/2728] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:46 2022] POST /identity/v3/projects => generated 384 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:47.024555 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.056585 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32994118a4204798a11263b254c41b55', 'request_id': 'req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:47.075252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32994118a4204798a11263b254c41b55', 'request_id': 'req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:47.090789 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32994118a4204798a11263b254c41b55', 'request_id': 'req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:47.117664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] The token cache is being invalidate because project 32994118a4204798a11263b254c41b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:47.118554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:47.120377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bbf5bdd1-6355-4201-9751-f83f0a4aac1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:47.123199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1360/2729] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:46 2022] DELETE /identity/v3/projects/32994118a4204798a11263b254c41b55 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:47.129290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825d94-1a9b-47ed-87a3-6917034448c1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.134688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825d94-1a9b-47ed-87a3-6917034448c1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.134688 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb825d94-1a9b-47ed-87a3-6917034448c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.154579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaaac4-9465-41f4-a9f8-48119662162c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.160341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.162450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.162744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.163031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.163717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.164683 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fb825d94-1a9b-47ed-87a3-6917034448c1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:47.166448 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb825d94-1a9b-47ed-87a3-6917034448c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:47.172041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.181548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1361/2730] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:47.196406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cb6b-fed9-4894-a63a-b1025332893b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.197027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cb6b-fed9-4894-a63a-b1025332893b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.197505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cb6b-fed9-4894-a63a-b1025332893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.201546 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:47.210658 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1370/2731] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:47 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:47.211691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.216990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:47.233108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1d09cb6b-fed9-4894-a63a-b1025332893b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:47.235484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1d09cb6b-fed9-4894-a63a-b1025332893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:47.243940 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155ab92-c94d-4a67-abb7-728e20e15273 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.250980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1362/2732] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:47.252485 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.253650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.254057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.254447 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.255562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.255911 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cb6b-fed9-4894-a63a-b1025332893b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.258685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.275990 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cb6b-fed9-4894-a63a-b1025332893b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.284347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1371/2733] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:47 2022] GET /identity/v3/roles => generated 1427 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:47.291870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.305169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c3ae7-033c-422c-a820-e98b9391dad3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.309083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.309992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.310514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.312038 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.312904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.316685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.317180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.317876 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.318731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.318889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:47.319214 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.320907 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.321152 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.341733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1372/2734] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:47 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:47.341733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.350220 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1363/2735] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:10:47.356940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.359021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29426c3-e944-43e4-b2af-a1459bd4668b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.366633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.367919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.368542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.369154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] PATH_INFO: `/v3/projects/4be9c2cca675402b9aef9c3765e9407b/users/154a30979a1f4b649449d5d08007353b/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.377174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e63d6-a8eb-412b-a6e8-e78c9c48e4b2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.387455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ecadb-8fd7-4d8b-bc5d-6dfdb687881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.389002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ecadb-8fd7-4d8b-bc5d-6dfdb687881e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.389763 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ecadb-8fd7-4d8b-bc5d-6dfdb687881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.390515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ecadb-8fd7-4d8b-bc5d-6dfdb687881e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.398296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be9c2cca675402b9aef9c3765e9407b, user_id=154a30979a1f4b649449d5d08007353b, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.398296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.400034 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ecadb-8fd7-4d8b-bc5d-6dfdb687881e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.405110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ecadb-8fd7-4d8b-bc5d-6dfdb687881e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.426081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1373/2736] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:47 2022] PUT /identity/v3/projects/4be9c2cca675402b9aef9c3765e9407b/users/154a30979a1f4b649449d5d08007353b/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:47.451366 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1364/2737] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:47 2022] POST /identity/v3/projects => generated 406 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:47.457831 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.505650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.505994 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.506299 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.555363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] MFA Rules not processed for user `154a30979a1f4b649449d5d08007353b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:47.556650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:47.564816 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:47.592738 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9abf72-9b17-4b7a-b3ea-0fa7cd4d036e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.653106 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1365/2738] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:47.670533 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.672018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:47.690559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.691404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.691404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.692504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.692814 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.694962 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.743396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1374/2739] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:47 2022] POST /identity/v3/users => generated 304 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:47.748494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.760298 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a66f5-f305-4a50-b552-2c1e02cde1ec admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.766811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.767606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.768309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.768309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.769305 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.771085 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.783674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1375/2740] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:47 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:47.789288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.791317 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ef862-97bc-4260-85a1-d3d7502c8664 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.796651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.797243 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.797528 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.797809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.809471 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.811018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.820116 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378681-8044-411f-bacd-e898e51cbd81 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.824515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1366/2741] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:47.829079 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.830477 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.830970 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.831952 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.832920 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.835810 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.862833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1376/2742] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:47 2022] GET /identity/v3/roles => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:47.865105 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.867012 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:47.879276 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3f7cc-0c80-41c7-88fd-2fd149246358 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.883616 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571ce4f-991f-4c6f-9d72-2a178627a160 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:47.893605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe528a9-3627-4d7c-bea1-73549d9e8af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.894534 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe528a9-3627-4d7c-bea1-73549d9e8af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.894906 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe528a9-3627-4d7c-bea1-73549d9e8af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.895194 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe528a9-3627-4d7c-bea1-73549d9e8af7 admin admin] PATH_INFO: `/v3/projects/aff8848adaee44e19366bce9661faf6e/users/95e6c48370d9425ea1746ec8c5157585/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.900744 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:47.901494 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.901925 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.902664 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] PATH_INFO: `/v3/users/154a30979a1f4b649449d5d08007353b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.903882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154a30979a1f4b649449d5d08007353b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.905821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.925277 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe528a9-3627-4d7c-bea1-73549d9e8af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff8848adaee44e19366bce9661faf6e, user_id=95e6c48370d9425ea1746ec8c5157585, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:47.929714 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe528a9-3627-4d7c-bea1-73549d9e8af7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:47.952541 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:47.954089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1367/2743] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:47 2022] PUT /identity/v3/projects/aff8848adaee44e19366bce9661faf6e/users/95e6c48370d9425ea1746ec8c5157585/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:47.960319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:47.961227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:47.961768 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:47.993574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154a30979a1f4b649449d5d08007353b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:48.000563 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:48.001854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:48.006385 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154a30979a1f4b649449d5d08007353b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:48.033965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154a30979a1f4b649449d5d08007353b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:48.034501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154a30979a1f4b649449d5d08007353b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:48.035136 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9fcb1b41-23a4-4846-91cc-843cc71439a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154a30979a1f4b649449d5d08007353b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:48.058137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1377/2744] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:47 2022] DELETE /identity/v3/users/154a30979a1f4b649449d5d08007353b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:48.066095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4982dd-6505-47a6-932a-c526f4344245 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:48.066946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4982dd-6505-47a6-932a-c526f4344245 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:48.068039 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4982dd-6505-47a6-932a-c526f4344245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:48.093820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3a4982dd-6505-47a6-932a-c526f4344245 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:48.102857 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a4982dd-6505-47a6-932a-c526f4344245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:48.123960 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1368/2745] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:48.131247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:48.135078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:48.220976 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:48.253139 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1378/2746] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:48.261271 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37e3c-1914-474f-8894-0f9de83e95bf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:48.268328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4982dd-6505-47a6-932a-c526f4344245 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:48.373879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:48.376109 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:48.376470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:48.376673 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:48.379641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4982dd-6505-47a6-932a-c526f4344245 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:48.385703 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112baa14-207f-41c8-9c26-11314679b552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:48.387000 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112baa14-207f-41c8-9c26-11314679b552 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:48.387404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112baa14-207f-41c8-9c26-11314679b552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:48.387674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112baa14-207f-41c8-9c26-11314679b552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:48.388391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:48.390043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:48.399745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112baa14-207f-41c8-9c26-11314679b552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:48.401242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112baa14-207f-41c8-9c26-11314679b552 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:48.404807 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1369/2747] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:48.424523 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1379/2748] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:10:49.108480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:49.110468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:49.138931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefda56-0729-45ec-8902-a46e9141bdac service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:49.154410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:49.155664 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:49.156124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:49.156596 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] PATH_INFO: `/v3/projects/4be9c2cca675402b9aef9c3765e9407b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:49.157971 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be9c2cca675402b9aef9c3765e9407b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:49.160054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:49.319641 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be9c2cca675402b9aef9c3765e9407b', 'request_id': 'req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:49.345649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be9c2cca675402b9aef9c3765e9407b', 'request_id': 'req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:49.371120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be9c2cca675402b9aef9c3765e9407b', 'request_id': 'req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:49.399040 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] The token cache is being invalidate because project 4be9c2cca675402b9aef9c3765e9407b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:49.400069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:49.401115 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfebbb86-cb8e-4d3a-bb8b-b112b92458f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:49.405358 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1370/2749] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:49 2022] DELETE /identity/v3/projects/4be9c2cca675402b9aef9c3765e9407b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:49.412830 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a84a-f45e-45ea-b1ba-82287598f537 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:49.413640 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a84a-f45e-45ea-b1ba-82287598f537 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:49.413819 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59a84a-f45e-45ea-b1ba-82287598f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:49.445784 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4f59a84a-f45e-45ea-b1ba-82287598f537 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:49.447361 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4f59a84a-f45e-45ea-b1ba-82287598f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:49.516567 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:49.572056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1380/2750] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:49.574074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ffd17-4ba5-440f-9b87-e86e7be92f05 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:49.574481 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ffd17-4ba5-440f-9b87-e86e7be92f05 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:49.574870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ffd17-4ba5-440f-9b87-e86e7be92f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:49.612594 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d06ffd17-4ba5-440f-9b87-e86e7be92f05 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:49.613912 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d06ffd17-4ba5-440f-9b87-e86e7be92f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:49.629377 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1371/2751] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:49.636816 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59a84a-f45e-45ea-b1ba-82287598f537 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:49.655415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59a84a-f45e-45ea-b1ba-82287598f537 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:49.670958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:49.672684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:49.673254 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:49.675191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:49.675191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:49.681064 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:49.683981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:49.685885 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:49.686107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:49.686371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:49.723170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1381/2752] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:10:49.730683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:49.748742 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8b36-699b-4f20-9666-68558a90b25d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:49.757719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:49.758741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:49.759220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:49.759734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:49.760910 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:49.765069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] MFA Rules not processed for user `95e6c48370d9425ea1746ec8c5157585`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:49.765336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:49.770091 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:49.815775 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1382/2753] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:49 2022] POST /identity/v3/projects => generated 386 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:49.822337 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:49.859204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:49.898397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1372/2754] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:49.907419 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:49.909630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:49.935603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6411a-e1a6-4b80-a68b-f895bd9de967 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:49.959364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f377f-570e-4d74-b6a7-fe8af625b31f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:49.965931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:49.967550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:49.968142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:49.968560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:49.969322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:49.972253 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.005362 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1383/2755] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:49 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:50.010709 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.026423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87218df2-4eb7-4c2a-87f7-1bb93f6d0ece admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.037654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.038929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.039377 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.039973 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.041150 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.048239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.067183 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.067940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.068455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.068649 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.069568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.071629 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.074618 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1384/2756] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:50 2022] GET /identity/v3/roles => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:50.080256 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.094804 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dfa44-f9ba-4e9f-a6aa-92dd95a91a42 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.100923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.101592 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.101879 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.102179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.102930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.104561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.109335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1373/2757] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:49 2022] POST /identity/v3/projects => generated 404 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:50.113977 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.129766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1385/2758] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:50 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:50.138919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.158057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a878-17d9-459e-ad72-371344d46a8e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.205078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e317e88-663f-4c65-b563-c61a6a5d291e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.214127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.215217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.215606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.216260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.217395 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.220029 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.258311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1374/2759] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:50 2022] POST /identity/v3/users => generated 309 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:50.263327 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.264718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bfa18-4db1-4ded-b47d-c48fa6633d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.265641 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bfa18-4db1-4ded-b47d-c48fa6633d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.265995 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bfa18-4db1-4ded-b47d-c48fa6633d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.266393 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bfa18-4db1-4ded-b47d-c48fa6633d88 admin admin] PATH_INFO: `/v3/projects/5a970e3f256a46258c5dc401477967b8/users/acdb3d3fc96b45b197ea0f22c4e763f9/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.276266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46258a-c1ba-46ab-9a32-865cca9881bc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.281308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.281946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.282221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.282587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.283319 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.285020 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.290466 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bfa18-4db1-4ded-b47d-c48fa6633d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a970e3f256a46258c5dc401477967b8, user_id=acdb3d3fc96b45b197ea0f22c4e763f9, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.293524 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bfa18-4db1-4ded-b47d-c48fa6633d88 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.296866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1375/2760] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:50 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:50.301723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.310797 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:50.313021 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d4a9d-eb59-42af-8f88-b6f232f2ac75 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.319644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1386/2761] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:50 2022] PUT /identity/v3/projects/5a970e3f256a46258c5dc401477967b8/users/acdb3d3fc96b45b197ea0f22c4e763f9/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:50.329438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.329941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.330322 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.357323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:50.359348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:50.401576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:50.415933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.417406 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.418499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.418920 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] PATH_INFO: `/v3/projects/1f9b9e5f24d347878288c3c556c7a878/users/0b938431c2ae43c4a5aa3f0eb5e2613f/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.440673 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1387/2762] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:50.445023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9b9e5f24d347878288c3c556c7a878, user_id=0b938431c2ae43c4a5aa3f0eb5e2613f, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.448464 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.454714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.456320 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:50.466586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1376/2763] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:50 2022] PUT /identity/v3/projects/1f9b9e5f24d347878288c3c556c7a878/users/0b938431c2ae43c4a5aa3f0eb5e2613f/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:50.470957 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.526761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c33b1e-a8e4-47a3-bf2e-73af96992bbf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.545695 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08cd71-aeb6-4e01-9153-243fa0a1b20b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.550699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.551359 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.551646 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.551925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.552630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.554284 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.570996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1377/2764] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:50 2022] GET /identity/v3/roles => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:10:50.576489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:50.587255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6f41-08de-44d0-83a5-215fc0aadd7f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:50.592127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22032c-0dff-4eaa-b118-1d9661106778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.592817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22032c-0dff-4eaa-b118-1d9661106778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.593099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22032c-0dff-4eaa-b118-1d9661106778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.593385 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22032c-0dff-4eaa-b118-1d9661106778 admin admin] PATH_INFO: `/v3/projects/1f9b9e5f24d347878288c3c556c7a878/users/0b938431c2ae43c4a5aa3f0eb5e2613f/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.595564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22032c-0dff-4eaa-b118-1d9661106778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9b9e5f24d347878288c3c556c7a878, user_id=0b938431c2ae43c4a5aa3f0eb5e2613f, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.597187 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:50.597919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:50.598216 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22032c-0dff-4eaa-b118-1d9661106778 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.598471 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:50.598832 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:50.609726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1378/2765] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:50 2022] PUT /identity/v3/projects/1f9b9e5f24d347878288c3c556c7a878/users/0b938431c2ae43c4a5aa3f0eb5e2613f/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:50.610726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:50.613114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:50.632655 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1388/2766] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:51.823817 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec5473-599f-4e40-847f-ee4654a3bb25 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:51.824756 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec5473-599f-4e40-847f-ee4654a3bb25 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:51.825209 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec5473-599f-4e40-847f-ee4654a3bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:51.860315 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-45ec5473-599f-4e40-847f-ee4654a3bb25 None None] MFA Rules not processed for user `0b938431c2ae43c4a5aa3f0eb5e2613f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:51.862518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45ec5473-599f-4e40-847f-ee4654a3bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:52.000308 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1379/2767] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:54.179215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:54.203049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadeaa-35a4-4349-93bf-1d52809c2606 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:54.331352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:54.332448 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:54.332933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:54.333674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] PATH_INFO: `/v3/users/95e6c48370d9425ea1746ec8c5157585` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:54.336215 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e6c48370d9425ea1746ec8c5157585)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:54.340060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:54.342795 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:54.427063 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e6c48370d9425ea1746ec8c5157585'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:54.445501 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e6c48370d9425ea1746ec8c5157585'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:54.494702 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e6c48370d9425ea1746ec8c5157585'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:54.496719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e6c48370d9425ea1746ec8c5157585'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:54.498346 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e6c48370d9425ea1746ec8c5157585'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:54.525719 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1389/2768] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:54 2022] DELETE /identity/v3/users/95e6c48370d9425ea1746ec8c5157585 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:54.790169 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec5473-599f-4e40-847f-ee4654a3bb25 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:54.804371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec5473-599f-4e40-847f-ee4654a3bb25 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:54.910069 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:54.943151 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:54.943969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:54.945227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:54.945726 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] PATH_INFO: `/v3/projects/aff8848adaee44e19366bce9661faf6e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:54.950584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff8848adaee44e19366bce9661faf6e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:54.958215 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:55.025905 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff8848adaee44e19366bce9661faf6e', 'request_id': 'req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.033247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff8848adaee44e19366bce9661faf6e', 'request_id': 'req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.045128 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff8848adaee44e19366bce9661faf6e', 'request_id': 'req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.060290 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] The token cache is being invalidate because project aff8848adaee44e19366bce9661faf6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:55.060738 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.061669 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.067165 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1380/2769] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:54 2022] DELETE /identity/v3/projects/aff8848adaee44e19366bce9661faf6e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:55.068197 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:55.069681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:55.083829 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431bf5-2ed1-4894-8247-760f8182886c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:55.179072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:55.180092 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:55.180654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:55.180654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] PATH_INFO: `/v3/users/0b938431c2ae43c4a5aa3f0eb5e2613f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:55.182140 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b938431c2ae43c4a5aa3f0eb5e2613f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:55.184614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:55.262500 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b938431c2ae43c4a5aa3f0eb5e2613f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.272379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b938431c2ae43c4a5aa3f0eb5e2613f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.292002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b938431c2ae43c4a5aa3f0eb5e2613f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.293075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b938431c2ae43c4a5aa3f0eb5e2613f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.294069 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a372bcd1-a0a4-43cb-b89f-5bc5973bd7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b938431c2ae43c4a5aa3f0eb5e2613f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.306755 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:55.321460 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1390/2770] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:10:55 2022] DELETE /identity/v3/users/0b938431c2ae43c4a5aa3f0eb5e2613f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:10:55.686693 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:55.688393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:55.713492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43f7b-09ca-4e05-b8b0-b9a46e7acc1a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:55.831117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:55.832196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:55.832196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:55.832564 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] PATH_INFO: `/v3/projects/1f9b9e5f24d347878288c3c556c7a878` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:55.833620 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9b9e5f24d347878288c3c556c7a878)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:55.835685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:55.948871 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9b9e5f24d347878288c3c556c7a878', 'request_id': 'req-68e30afb-c04b-4f29-89d2-6a353b3f9578'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.971324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9b9e5f24d347878288c3c556c7a878', 'request_id': 'req-68e30afb-c04b-4f29-89d2-6a353b3f9578'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:55.990324 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9b9e5f24d347878288c3c556c7a878', 'request_id': 'req-68e30afb-c04b-4f29-89d2-6a353b3f9578'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:56.026129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] The token cache is being invalidate because project 1f9b9e5f24d347878288c3c556c7a878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:10:56.026459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:56.027522 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-68e30afb-c04b-4f29-89d2-6a353b3f9578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:10:56.029595 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1381/2771] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:10:55 2022] DELETE /identity/v3/projects/1f9b9e5f24d347878288c3c556c7a878 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:56.037674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea46c1e-1e46-4c6b-b163-0ad8a9ebd2ae None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.038227 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea46c1e-1e46-4c6b-b163-0ad8a9ebd2ae None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.038725 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea46c1e-1e46-4c6b-b163-0ad8a9ebd2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.073668 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-aea46c1e-1e46-4c6b-b163-0ad8a9ebd2ae None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:56.075199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aea46c1e-1e46-4c6b-b163-0ad8a9ebd2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:56.230536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1391/2772] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:56.236124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a932-c320-4c91-80c2-bde20fcaa460 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.236543 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a932-c320-4c91-80c2-bde20fcaa460 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.237124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a932-c320-4c91-80c2-bde20fcaa460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.264623 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:56.275490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b346a932-c320-4c91-80c2-bde20fcaa460 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:56.278870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b346a932-c320-4c91-80c2-bde20fcaa460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:56.299321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1382/2773] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:56.305850 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea46c1e-1e46-4c6b-b163-0ad8a9ebd2ae None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:56.317761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea46c1e-1e46-4c6b-b163-0ad8a9ebd2ae None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:56.324423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:56.325109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.325419 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.325785 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.326727 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:10:56.326941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:56.328789 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:56.347762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1392/2774] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:10:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:10:56.352529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a932-c320-4c91-80c2-bde20fcaa460 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:56.377652 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a932-c320-4c91-80c2-bde20fcaa460 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:56.384325 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:56.384974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.385307 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.385584 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.386343 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:56.388757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:56.468070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1383/2775] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:56 2022] POST /identity/v3/projects => generated 372 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:56.472895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:56.488552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c6e1a-0024-40d7-926f-e1610e2f4713 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:56.598660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a9c6b-626a-4c30-b112-acb482a21f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:56.600503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a9c6b-626a-4c30-b112-acb482a21f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.600963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a9c6b-626a-4c30-b112-acb482a21f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.601338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a9c6b-626a-4c30-b112-acb482a21f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.602428 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a9c6b-626a-4c30-b112-acb482a21f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:56.605308 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a9c6b-626a-4c30-b112-acb482a21f4e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:56.643350 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1393/2776] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:56 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:56.659166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:56.665192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b4d06-392a-428b-82be-5f5d29d7a969 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:56.666762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.666762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.666762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.669640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:56.670468 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.670754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.671039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.671745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:56.673389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:56.688337 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1384/2777] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:56 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:56.692424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:56.710992 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] MFA Rules not processed for user `acdb3d3fc96b45b197ea0f22c4e763f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:56.711282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95bac3-fd3a-4a25-87b6-a98e346d9347 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:56.712364 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:56.719365 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:56.720891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.721298 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.721973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.723129 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:56.726710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:56.743342 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1385/2778] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:56 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:56.752630 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:56.772304 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f62f8-d3b6-4941-88e0-4eaf8ac40e07 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:56.779301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e754c8-5505-4a53-a0d5-005b9a0d0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:56.780001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e754c8-5505-4a53-a0d5-005b9a0d0d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.780287 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e754c8-5505-4a53-a0d5-005b9a0d0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.780568 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e754c8-5505-4a53-a0d5-005b9a0d0d8b admin admin] PATH_INFO: `/v3/projects/4e1c635e3b424464a497743121c4bfd8/users/e60ce282fdbe4791aa9c5d00aca9da88/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.800158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e754c8-5505-4a53-a0d5-005b9a0d0d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1c635e3b424464a497743121c4bfd8, user_id=e60ce282fdbe4791aa9c5d00aca9da88, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:56.802931 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e754c8-5505-4a53-a0d5-005b9a0d0d8b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:56.818480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1394/2779] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:56.826706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1386/2780] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:56 2022] PUT /identity/v3/projects/4e1c635e3b424464a497743121c4bfd8/users/e60ce282fdbe4791aa9c5d00aca9da88/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:56.827562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:56.829943 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:56.841198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b47cb-c5b8-42e6-aff1-71beced3bdbd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.841939 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b47cb-c5b8-42e6-aff1-71beced3bdbd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.842164 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b47cb-c5b8-42e6-aff1-71beced3bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.845057 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:56.850219 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5318-6263-4c43-895c-ac45aead162b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:56.888541 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e37b47cb-c5b8-42e6-aff1-71beced3bdbd None None] MFA Rules not processed for user `e60ce282fdbe4791aa9c5d00aca9da88`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:56.890185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e37b47cb-c5b8-42e6-aff1-71beced3bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:56.956242 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:56.956891 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:56.957177 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:56.957530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:56.958294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:56.960614 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.008759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1395/2781] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:56 2022] POST /identity/v3/projects => generated 384 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:57.014059 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.023969 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1387/2782] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:10:57.033461 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b47cb-c5b8-42e6-aff1-71beced3bdbd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.055739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b47cb-c5b8-42e6-aff1-71beced3bdbd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.133867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8f39-5ea7-4daa-9c27-f573cb9e7b67 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.140674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.141691 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.142540 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.142858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.143951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.145998 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.162334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.163328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.163554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.163815 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.164538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.167940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.180180 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1396/2783] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:57 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:57.184938 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.196458 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e315-2d3b-44f4-914a-588f20950c25 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.200706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1388/2784] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:10:57 2022] POST /identity/v3/projects => generated 374 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:10:57.202965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.203931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.203931 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.204230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.205067 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.205775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.206853 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.216948 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:57.221236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1397/2785] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:57 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:57.227825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.243461 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4264b-89ed-44c3-99fb-e737f52eb755 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.305016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96dbb-9dff-4d78-98e1-123d3d856c69 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.313260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.314455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.315001 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.315520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.316930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.319194 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.320196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.320352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.320895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.321407 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] PATH_INFO: `/v3/projects/d065b680d0f64134b21eed3b1d1b3708/users/eeb5554ebda247fd93699e47cffdcfb0/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.345824 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:57.357971 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d065b680d0f64134b21eed3b1d1b3708, user_id=eeb5554ebda247fd93699e47cffdcfb0, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.360985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.361663 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1389/2786] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:10:57 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:10:57.366689 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.379232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3788a97-6667-423e-bc89-50c6ad678f3d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.390349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1398/2787] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:57 2022] PUT /identity/v3/projects/d065b680d0f64134b21eed3b1d1b3708/users/eeb5554ebda247fd93699e47cffdcfb0/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:57.396809 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.478740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.481917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.481917 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.483295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.484494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.486622 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.504825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1390/2788] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:57 2022] GET /identity/v3/roles => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:57.505896 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.517252 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0037b-2ec1-4f18-b192-fd1ee75bdde0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.518054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699251-b28d-42fd-98a4-d72cf6d464a1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.522999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.523706 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.523992 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.524278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] PATH_INFO: `/v3/projects/73558cd9a50f41e395de25a3eedbf54e/users/9a93770ce1814495b0725be1bfd21ff3/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.524855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.525934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.526411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.526869 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.527847 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.529722 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.541455 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1399/2789] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:57 2022] GET /identity/v3/roles => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:57.544973 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] RBAC: Authorizing `identity:create_grant(project_id=73558cd9a50f41e395de25a3eedbf54e, user_id=9a93770ce1814495b0725be1bfd21ff3, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.548504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.549005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.568603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1391/2790] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:57 2022] PUT /identity/v3/projects/73558cd9a50f41e395de25a3eedbf54e/users/9a93770ce1814495b0725be1bfd21ff3/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:57.568963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c993d3b-6f92-4a35-9da1-53f3d53826fd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.574462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.674717 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.675684 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.676184 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.676705 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] PATH_INFO: `/v3/projects/d065b680d0f64134b21eed3b1d1b3708/users/eeb5554ebda247fd93699e47cffdcfb0/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.680529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d065b680d0f64134b21eed3b1d1b3708, user_id=eeb5554ebda247fd93699e47cffdcfb0, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.685483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.697022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1400/2791] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:57 2022] PUT /identity/v3/projects/d065b680d0f64134b21eed3b1d1b3708/users/eeb5554ebda247fd93699e47cffdcfb0/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:57.704614 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec466d7-6a58-4b78-84f7-1567d8c026db admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.729777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:10:57.798423 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3324e3-df43-48bc-aaa0-d0e04ccbc2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.799068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3324e3-df43-48bc-aaa0-d0e04ccbc2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.799436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3324e3-df43-48bc-aaa0-d0e04ccbc2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.799942 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3324e3-df43-48bc-aaa0-d0e04ccbc2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.800508 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3324e3-df43-48bc-aaa0-d0e04ccbc2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.802126 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3324e3-df43-48bc-aaa0-d0e04ccbc2d8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.813865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1392/2792] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:10:57 2022] GET /identity/v3/roles => generated 1427 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:10:57.818365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:57.840552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ded50-7b0f-4471-8d8c-5d879b963982 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:57.847748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:57.848439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.848718 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.848990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] PATH_INFO: `/v3/projects/73558cd9a50f41e395de25a3eedbf54e/users/9a93770ce1814495b0725be1bfd21ff3/roles/0b911707f2884d61bd847b72d704811f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.852468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73558cd9a50f41e395de25a3eedbf54e, user_id=9a93770ce1814495b0725be1bfd21ff3, role_id=0b911707f2884d61bd847b72d704811f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:57.857134 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:57.870603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1401/2793] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:10:57 2022] PUT /identity/v3/projects/73558cd9a50f41e395de25a3eedbf54e/users/9a93770ce1814495b0725be1bfd21ff3/roles/0b911707f2884d61bd847b72d704811f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:10:57.889273 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c615-2143-4665-9fb8-395936fa0c78 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:57.890043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c615-2143-4665-9fb8-395936fa0c78 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:57.890043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c615-2143-4665-9fb8-395936fa0c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:57.935049 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0383c615-2143-4665-9fb8-395936fa0c78 None None] MFA Rules not processed for user `9a93770ce1814495b0725be1bfd21ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:10:57.936360 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0383c615-2143-4665-9fb8-395936fa0c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:58.049322 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1393/2794] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:10:58.064360 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:58.066167 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:10:58.220677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df715b-90f6-4dea-ab5e-fe18c3bae7b4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:58.227398 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181037-9c19-4219-ba34-61b616a53c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:58.228052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181037-9c19-4219-ba34-61b616a53c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:58.228474 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181037-9c19-4219-ba34-61b616a53c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:58.228587 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181037-9c19-4219-ba34-61b616a53c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:58.240290 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181037-9c19-4219-ba34-61b616a53c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:58.242153 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181037-9c19-4219-ba34-61b616a53c7a service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:58.268195 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1402/2795] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:10:58.374576 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383c615-2143-4665-9fb8-395936fa0c78 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:10:58.392597 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383c615-2143-4665-9fb8-395936fa0c78 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:10:58.399179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:10:58.399962 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:10:58.400859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:10:58.400859 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:10:58.490886 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:10:58.492856 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:10:58.507335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1394/2796] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:10:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:05.022218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db79a-c173-4710-9595-9edeb6fa8a80 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:05.022904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db79a-c173-4710-9595-9edeb6fa8a80 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:05.023754 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db79a-c173-4710-9595-9edeb6fa8a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:05.072070 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:05.084774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-bd8db79a-c173-4710-9595-9edeb6fa8a80 None None] MFA Rules not processed for user `eeb5554ebda247fd93699e47cffdcfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:05.087951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bd8db79a-c173-4710-9595-9edeb6fa8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:05.185529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1403/2797] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:05.199887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:05.201578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:05.265090 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:05.298149 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508a9f8-0edf-40dd-a258-d47c61d6be36 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:05.301997 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:05.302725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:05.303013 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:05.303293 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:05.389798 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:05.391869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:05.409367 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1395/2798] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 17:11:05.565264 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:05.565690 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:05.566049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:05.595005 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:05.596363 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:05.675272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1404/2799] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:11:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:11:05.736575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:05.738072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:05.836145 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5166a-d703-44af-8349-c46005f32359 service glance] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:05.844180 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba881b-d502-40e2-a3ea-832e10d37991 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:05.844982 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba881b-d502-40e2-a3ea-832e10d37991 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:05.845516 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba881b-d502-40e2-a3ea-832e10d37991 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:05.845889 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba881b-d502-40e2-a3ea-832e10d37991 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:05.856186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba881b-d502-40e2-a3ea-832e10d37991 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:05.858079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba881b-d502-40e2-a3ea-832e10d37991 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:05.868043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1396/2800] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:11:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:11:14.521783 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:14.523351 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:14.614043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44df32f-a8da-4752-9b42-6ee3396f9a66 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:14.618060 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9872-a7fb-4423-9699-61a7416da6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:14.618733 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9872-a7fb-4423-9699-61a7416da6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:14.619027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9872-a7fb-4423-9699-61a7416da6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:14.619338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9872-a7fb-4423-9699-61a7416da6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:14.623436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5c2b9872-a7fb-4423-9699-61a7416da6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:14.717077 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:14.742033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9872-a7fb-4423-9699-61a7416da6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:14.745456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9872-a7fb-4423-9699-61a7416da6a9 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:14.761576 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1405/2801] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:15.793137 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839bd42-5bb2-4729-9a7e-1a62af1196b8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:15.794451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839bd42-5bb2-4729-9a7e-1a62af1196b8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:15.794451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839bd42-5bb2-4729-9a7e-1a62af1196b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:15.814044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3839bd42-5bb2-4729-9a7e-1a62af1196b8 None None] MFA Rules not processed for user `acdb3d3fc96b45b197ea0f22c4e763f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:15.815416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3839bd42-5bb2-4729-9a7e-1a62af1196b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:15.822810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1397/2802] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:18.236369 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19931-2ec0-492f-a10f-36d1e3a373bd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:18.236866 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19931-2ec0-492f-a10f-36d1e3a373bd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:18.237072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c19931-2ec0-492f-a10f-36d1e3a373bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:18.271065 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-86c19931-2ec0-492f-a10f-36d1e3a373bd None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:18.272588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-86c19931-2ec0-492f-a10f-36d1e3a373bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:18.280307 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1406/2803] 10.222.0.121 () {58 vars in 1014 bytes} [Mon Aug 1 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:18.294548 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839bd42-5bb2-4729-9a7e-1a62af1196b8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:18.309275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839bd42-5bb2-4729-9a7e-1a62af1196b8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:18.314793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc6574-758c-49a2-87c6-263f687d4734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:18.315515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6574-758c-49a2-87c6-263f687d4734 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:18.315891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6574-758c-49a2-87c6-263f687d4734 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:18.316334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc6574-758c-49a2-87c6-263f687d4734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:18.325776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc6574-758c-49a2-87c6-263f687d4734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:18.327404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc6574-758c-49a2-87c6-263f687d4734 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:18.335921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1398/2804] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:11:28.261372 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:28.332509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=73 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:30.685643 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c19931-2ec0-492f-a10f-36d1e3a373bd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:30.795099 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c19931-2ec0-492f-a10f-36d1e3a373bd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:30.799710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:30.800347 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:30.800631 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:30.800911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] PATH_INFO: `/v3/users/e60ce282fdbe4791aa9c5d00aca9da88` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:30.802095 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60ce282fdbe4791aa9c5d00aca9da88)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:30.804031 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:30.850028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60ce282fdbe4791aa9c5d00aca9da88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:30.856882 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60ce282fdbe4791aa9c5d00aca9da88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:30.869667 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60ce282fdbe4791aa9c5d00aca9da88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:30.870376 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60ce282fdbe4791aa9c5d00aca9da88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:30.870986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60ce282fdbe4791aa9c5d00aca9da88'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:30.887252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1407/2805] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:11:30 2022] DELETE /identity/v3/users/e60ce282fdbe4791aa9c5d00aca9da88 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:30.891561 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:30.891974 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:30.892156 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:30.942514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:30.943734 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:31.005239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1399/2806] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:31.015043 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:31.016475 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:31.059101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:31.092875 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891158d-afe8-4cef-bcbb-86fdaaf28831 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:31.096533 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:31.097159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:31.097445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:31.097723 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:31.108160 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:31.109689 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:31.120277 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1408/2807] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:31.397480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:31.399066 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:31.411401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5832-ce6b-42e4-bc9f-e2359ee76da6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:31.417375 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:31.418204 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:31.418531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:31.418809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] PATH_INFO: `/v3/projects/4e1c635e3b424464a497743121c4bfd8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:31.420279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1c635e3b424464a497743121c4bfd8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:31.422206 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:31.477123 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1c635e3b424464a497743121c4bfd8', 'request_id': 'req-ecb00089-3481-427e-a05b-73d706a19fe3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.483651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1c635e3b424464a497743121c4bfd8', 'request_id': 'req-ecb00089-3481-427e-a05b-73d706a19fe3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.532666 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1c635e3b424464a497743121c4bfd8', 'request_id': 'req-ecb00089-3481-427e-a05b-73d706a19fe3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.557196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] The token cache is being invalidate because project 4e1c635e3b424464a497743121c4bfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:11:31.557660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.559085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.560792 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1400/2808] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:11:31 2022] DELETE /identity/v3/projects/4e1c635e3b424464a497743121c4bfd8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:31.565066 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:31.576964 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ab069-4bd4-439e-95e2-a9cbe8b90718 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:31.661872 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:31.662571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:31.662978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:31.663311 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] PATH_INFO: `/v3/users/9a93770ce1814495b0725be1bfd21ff3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:31.665196 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a93770ce1814495b0725be1bfd21ff3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:31.667758 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:31.733556 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a93770ce1814495b0725be1bfd21ff3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.742963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a93770ce1814495b0725be1bfd21ff3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.763483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a93770ce1814495b0725be1bfd21ff3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.764390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a93770ce1814495b0725be1bfd21ff3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.765171 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3d0b0078-eb1d-4024-b97d-b0118f00c8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a93770ce1814495b0725be1bfd21ff3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:31.789562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1409/2809] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:11:31 2022] DELETE /identity/v3/users/9a93770ce1814495b0725be1bfd21ff3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:32.076068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.077609 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:32.093545 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00089-3481-427e-a05b-73d706a19fe3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.148184 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:32.158451 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.159144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.159699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.160257 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] PATH_INFO: `/v3/projects/73558cd9a50f41e395de25a3eedbf54e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.161587 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73558cd9a50f41e395de25a3eedbf54e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.163592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.217945 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73558cd9a50f41e395de25a3eedbf54e', 'request_id': 'req-0ac51cb9-9e2b-4faa-9948-c47716da4a70'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:32.224884 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73558cd9a50f41e395de25a3eedbf54e', 'request_id': 'req-0ac51cb9-9e2b-4faa-9948-c47716da4a70'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:32.233910 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73558cd9a50f41e395de25a3eedbf54e', 'request_id': 'req-0ac51cb9-9e2b-4faa-9948-c47716da4a70'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:32.244701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] The token cache is being invalidate because project 73558cd9a50f41e395de25a3eedbf54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:11:32.244998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:32.245651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ac51cb9-9e2b-4faa-9948-c47716da4a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:32.247239 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1401/2810] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:11:32 2022] DELETE /identity/v3/projects/73558cd9a50f41e395de25a3eedbf54e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:32.252114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4598e-3148-4c63-a493-bbf4e9c46ec2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.252404 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4598e-3148-4c63-a493-bbf4e9c46ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.252686 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4598e-3148-4c63-a493-bbf4e9c46ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.302001 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1bd4598e-3148-4c63-a493-bbf4e9c46ec2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:32.303271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1bd4598e-3148-4c63-a493-bbf4e9c46ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:32.316081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:32.365609 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1410/2811] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:32.373469 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3210fc-da93-4b33-93a4-701fc28122a5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.373764 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3210fc-da93-4b33-93a4-701fc28122a5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.374047 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3210fc-da93-4b33-93a4-701fc28122a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.394099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f3210fc-da93-4b33-93a4-701fc28122a5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:32.395352 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f3210fc-da93-4b33-93a4-701fc28122a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:32.404133 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1402/2812] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:32.408438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4598e-3148-4c63-a493-bbf4e9c46ec2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.419081 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4598e-3148-4c63-a493-bbf4e9c46ec2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.427114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.427732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.428022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.428302 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.428999 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:11:32.429306 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.430957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.442734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1411/2813] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:11:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:11:32.447694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3210fc-da93-4b33-93a4-701fc28122a5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.458427 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3210fc-da93-4b33-93a4-701fc28122a5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.465301 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.465950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.466238 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.466578 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.467260 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.469219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.497254 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1403/2814] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:11:32 2022] POST /identity/v3/projects => generated 374 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:11:32.501560 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.512502 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f45f-5b10-4f79-be13-5c34509ad679 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.572849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.573487 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.573769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.574041 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.574751 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.576674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.603740 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1412/2815] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:11:32 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:11:32.607918 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.620535 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3b064-cc1e-480b-9910-4ef101a3c49d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.624148 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.624781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.625096 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.625371 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.626083 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.627725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.641409 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1404/2816] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:11:32 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:11:32.646022 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.657165 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed3a7-a7d8-4596-8883-f47228d6113c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.661945 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85212-5c36-4ea8-a339-7bb801421790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.662596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85212-5c36-4ea8-a339-7bb801421790 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.662881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85212-5c36-4ea8-a339-7bb801421790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.663159 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85212-5c36-4ea8-a339-7bb801421790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.663854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85212-5c36-4ea8-a339-7bb801421790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.665450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85212-5c36-4ea8-a339-7bb801421790 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.676181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1413/2817] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:11:32 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:11:32.680524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.690877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630685f4-55b9-44b6-a5b9-8aa692f890ab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.695559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.696249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.696530 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.696808 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] PATH_INFO: `/v3/projects/eeb51a60db5445b895fef20d99fc7039/users/43dbc30d904848d8aa4fbf621d21a9f3/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.712466 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb51a60db5445b895fef20d99fc7039, user_id=43dbc30d904848d8aa4fbf621d21a9f3, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.715776 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.729144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1405/2818] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:11:32 2022] PUT /identity/v3/projects/eeb51a60db5445b895fef20d99fc7039/users/43dbc30d904848d8aa4fbf621d21a9f3/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:32.740607 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42e2c-21d4-4445-89a8-6a694b4a3267 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.741145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42e2c-21d4-4445-89a8-6a694b4a3267 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.741145 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb42e2c-21d4-4445-89a8-6a694b4a3267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.770934 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7bb42e2c-21d4-4445-89a8-6a694b4a3267 None None] MFA Rules not processed for user `43dbc30d904848d8aa4fbf621d21a9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:32.772438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7bb42e2c-21d4-4445-89a8-6a694b4a3267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:32.849109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1414/2819] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:32.862933 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:32.865250 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:32.929219 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1628-8a0a-4b18-b0d3-d087667ca3e4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:32.933690 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d627f6-9576-46cf-a76c-a91a23ba41df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:32.934354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d627f6-9576-46cf-a76c-a91a23ba41df service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:32.934642 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d627f6-9576-46cf-a76c-a91a23ba41df service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:32.934921 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d627f6-9576-46cf-a76c-a91a23ba41df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:32.949127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d627f6-9576-46cf-a76c-a91a23ba41df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:32.951389 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d627f6-9576-46cf-a76c-a91a23ba41df service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:32.963005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1406/2820] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:32.988341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42e2c-21d4-4445-89a8-6a694b4a3267 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:33.007047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:33.059695 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb42e2c-21d4-4445-89a8-6a694b4a3267 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:33.065979 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:33.067034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:33.067315 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:33.067588 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] PATH_INFO: `/v3/users/43dbc30d904848d8aa4fbf621d21a9f3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:33.068788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43dbc30d904848d8aa4fbf621d21a9f3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:33.070863 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:33.131597 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43dbc30d904848d8aa4fbf621d21a9f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.139552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43dbc30d904848d8aa4fbf621d21a9f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.154155 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43dbc30d904848d8aa4fbf621d21a9f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.154953 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43dbc30d904848d8aa4fbf621d21a9f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.155570 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43dbc30d904848d8aa4fbf621d21a9f3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.170978 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1415/2821] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:11:32 2022] DELETE /identity/v3/users/43dbc30d904848d8aa4fbf621d21a9f3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:33.176936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:33.177416 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:33.177514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:33.198016 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:33.199374 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:33.223391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:33.267078 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1407/2822] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:33.277911 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:33.279436 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:33.341169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa0827-19ae-4abf-98d8-e7500d948211 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:33.344859 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce346ceb-a934-4726-9530-d013aeeab0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:33.345476 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346ceb-a934-4726-9530-d013aeeab0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:33.345756 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346ceb-a934-4726-9530-d013aeeab0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:33.346029 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce346ceb-a934-4726-9530-d013aeeab0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:33.355877 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346ceb-a934-4726-9530-d013aeeab0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:33.357451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce346ceb-a934-4726-9530-d013aeeab0d6 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:33.368125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1416/2823] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:33.689538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:33.691479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:33.704431 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6498ad7-5a0e-40c9-aa19-2f233e81174b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:33.710781 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:33.711002 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:33.711278 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:33.711559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] PATH_INFO: `/v3/projects/eeb51a60db5445b895fef20d99fc7039` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:33.713628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb51a60db5445b895fef20d99fc7039)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:33.715972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:33.784743 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb51a60db5445b895fef20d99fc7039', 'request_id': 'req-f44d04ec-1761-46d0-8746-aee55c2b409c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.792274 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb51a60db5445b895fef20d99fc7039', 'request_id': 'req-f44d04ec-1761-46d0-8746-aee55c2b409c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.800624 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb51a60db5445b895fef20d99fc7039', 'request_id': 'req-f44d04ec-1761-46d0-8746-aee55c2b409c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.811259 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] The token cache is being invalidate because project eeb51a60db5445b895fef20d99fc7039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:11:33.811552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.812181 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f44d04ec-1761-46d0-8746-aee55c2b409c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:33.813682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1408/2824] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:11:33 2022] DELETE /identity/v3/projects/eeb51a60db5445b895fef20d99fc7039 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:33.818627 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e93a-533f-4a86-8a86-8cd3ec9e7063 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:33.819115 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e93a-533f-4a86-8a86-8cd3ec9e7063 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:33.819221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e93a-533f-4a86-8a86-8cd3ec9e7063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:33.840497 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b4c1e93a-533f-4a86-8a86-8cd3ec9e7063 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:33.841741 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b4c1e93a-533f-4a86-8a86-8cd3ec9e7063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:33.877508 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:33.918379 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1417/2825] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:33.937417 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95525-ca70-4e4e-b4e7-a89ab426ceb2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:33.937615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95525-ca70-4e4e-b4e7-a89ab426ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:33.937890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d95525-ca70-4e4e-b4e7-a89ab426ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:33.962292 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-72d95525-ca70-4e4e-b4e7-a89ab426ceb2 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:33.965054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-72d95525-ca70-4e4e-b4e7-a89ab426ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:33.974306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1409/2826] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:33.978644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1e93a-533f-4a86-8a86-8cd3ec9e7063 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:33.989271 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1e93a-533f-4a86-8a86-8cd3ec9e7063 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:33.998907 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:33.999551 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:33.999834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.000112 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.000813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:11:34.001121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:34.002766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:34.016552 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1418/2827] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:11:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:11:34.020981 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95525-ca70-4e4e-b4e7-a89ab426ceb2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:34.031336 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d95525-ca70-4e4e-b4e7-a89ab426ceb2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:34.036493 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:34.037125 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:34.037525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.037809 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.038531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:34.040489 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:34.070955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1410/2828] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:11:34 2022] POST /identity/v3/projects => generated 376 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:11:34.075710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:34.086183 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7a9e9-3bee-42b1-b21f-67b338494074 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:34.145415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:34.146309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:34.146605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.146881 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.147559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:34.149521 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:34.172341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1419/2829] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:11:34 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:11:34.176498 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:34.186955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8144-6feb-4643-ab2a-e0787ec0d881 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:34.191699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:34.192263 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:34.192546 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.192823 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.193519 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:34.195144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:34.206003 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1411/2830] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:11:34 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:11:34.209968 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:34.220957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594849c-400e-45d6-85c4-9ff30aa12a75 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:34.225956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cc76e-bed9-4fa2-848d-8b9fe03d558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:34.226732 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc76e-bed9-4fa2-848d-8b9fe03d558d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:34.227047 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc76e-bed9-4fa2-848d-8b9fe03d558d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.227328 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc76e-bed9-4fa2-848d-8b9fe03d558d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.228028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cc76e-bed9-4fa2-848d-8b9fe03d558d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:34.229677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cc76e-bed9-4fa2-848d-8b9fe03d558d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:34.240805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1420/2831] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:11:34 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:11:34.244923 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:34.254854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cc580-98dc-49e8-ad5b-0523d19df9b5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:34.259934 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:34.260575 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:34.260855 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.261144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] PATH_INFO: `/v3/projects/a031c03d9189416f987a1259e84b005d/users/06eb8ccb18414a66b2a32860fdba179a/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.276244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a031c03d9189416f987a1259e84b005d, user_id=06eb8ccb18414a66b2a32860fdba179a, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:34.279026 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:34.291744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1412/2832] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:11:34 2022] PUT /identity/v3/projects/a031c03d9189416f987a1259e84b005d/users/06eb8ccb18414a66b2a32860fdba179a/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:11:34.302317 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:34.303842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.303842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.331479 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] MFA Rules not processed for user `06eb8ccb18414a66b2a32860fdba179a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:34.332734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:34.397303 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1421/2833] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:34.408166 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:34.409852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:34.461619 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:34.468373 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144cd96-6029-4aa0-9bef-230dd2c80f03 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:34.473074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:34.473694 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:34.473972 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:34.474247 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:34.483174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:34.484605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:34.493376 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1413/2834] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:41.421237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:41.422799 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:41.461977 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:41.505287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2159d-d437-44f5-8a83-d915bcab499e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:41.508941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:41.509563 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:41.509848 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:41.510125 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:41.511914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:41.581289 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:41.582794 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:41.593288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1422/2835] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:44.489420 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:45.327658 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:45.329120 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:45.479782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca791f-ce6d-4833-acc1-0c3025ab2c43 service glance] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:45.488784 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7ce00-7a87-4083-a0ec-4591f18e10ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:45.489680 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ce00-7a87-4083-a0ec-4591f18e10ba service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:45.490240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ce00-7a87-4083-a0ec-4591f18e10ba service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:45.490240 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7ce00-7a87-4083-a0ec-4591f18e10ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:45.493028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9f7ce00-7a87-4083-a0ec-4591f18e10ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:45.514179 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7ce00-7a87-4083-a0ec-4591f18e10ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:45.515890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7ce00-7a87-4083-a0ec-4591f18e10ba service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:45.528505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1414/2836] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:50.035449 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:50.097753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5544dfe-285b-4e36-86a1-cbeb597bf1b4 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:50.102480 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:50.103760 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.104143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.104423 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] PATH_INFO: `/v3/users/06eb8ccb18414a66b2a32860fdba179a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.105605 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06eb8ccb18414a66b2a32860fdba179a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:50.107573 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:50.160164 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06eb8ccb18414a66b2a32860fdba179a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.167650 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06eb8ccb18414a66b2a32860fdba179a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.174468 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:50.180562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06eb8ccb18414a66b2a32860fdba179a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.181390 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06eb8ccb18414a66b2a32860fdba179a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.182231 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06eb8ccb18414a66b2a32860fdba179a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.194181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1423/2837] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:11:50 2022] DELETE /identity/v3/users/06eb8ccb18414a66b2a32860fdba179a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:50.198894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.199379 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.199518 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.218490 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:50.219685 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:50.277654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1415/2838] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:50.287344 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:50.288917 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:50.347473 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36209763-2adf-4016-8e46-54d9cf66cc1e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:50.351417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94017b2a-3547-4952-95d0-337a16f80f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:50.351899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017b2a-3547-4952-95d0-337a16f80f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.352216 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017b2a-3547-4952-95d0-337a16f80f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.352495 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94017b2a-3547-4952-95d0-337a16f80f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.362309 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94017b2a-3547-4952-95d0-337a16f80f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:50.363747 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94017b2a-3547-4952-95d0-337a16f80f58 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:50.373257 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1424/2839] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:11:50.638117 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:50.639946 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:50.654729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f99a4-4217-47c5-901f-5d86748e1312 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:50.660745 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:50.661401 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.661684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.661954 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] PATH_INFO: `/v3/projects/a031c03d9189416f987a1259e84b005d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.663186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a031c03d9189416f987a1259e84b005d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:50.665487 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:50.715950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a031c03d9189416f987a1259e84b005d', 'request_id': 'req-cbf0fb56-0680-4b50-afe7-a315adbae390'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.722053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a031c03d9189416f987a1259e84b005d', 'request_id': 'req-cbf0fb56-0680-4b50-afe7-a315adbae390'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.723739 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:50.730538 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a031c03d9189416f987a1259e84b005d', 'request_id': 'req-cbf0fb56-0680-4b50-afe7-a315adbae390'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.741393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] The token cache is being invalidate because project a031c03d9189416f987a1259e84b005d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:11:50.741684 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.742350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cbf0fb56-0680-4b50-afe7-a315adbae390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:11:50.743879 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1416/2840] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:11:50 2022] DELETE /identity/v3/projects/a031c03d9189416f987a1259e84b005d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:50.748846 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d652-d563-4edd-8ddd-1fad289cd998 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.749238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d652-d563-4edd-8ddd-1fad289cd998 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.749608 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d652-d563-4edd-8ddd-1fad289cd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.769590 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f105d652-d563-4edd-8ddd-1fad289cd998 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:50.771129 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f105d652-d563-4edd-8ddd-1fad289cd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:50.829769 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1425/2841] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:50.840202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12e20-abc0-49ce-8b5e-0cc1dc7d8cb1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.840497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12e20-abc0-49ce-8b5e-0cc1dc7d8cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.840780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12e20-abc0-49ce-8b5e-0cc1dc7d8cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.860121 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aaf12e20-abc0-49ce-8b5e-0cc1dc7d8cb1 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:50.861335 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aaf12e20-abc0-49ce-8b5e-0cc1dc7d8cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:50.869754 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1417/2842] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:50.873951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d652-d563-4edd-8ddd-1fad289cd998 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:50.884266 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d652-d563-4edd-8ddd-1fad289cd998 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:50.889575 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:50.890200 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.890504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.890774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.891465 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:11:50.891765 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:50.893353 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:50.905530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1426/2843] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:11:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:11:50.910203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf12e20-abc0-49ce-8b5e-0cc1dc7d8cb1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:50.919404 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf12e20-abc0-49ce-8b5e-0cc1dc7d8cb1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:50.923988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:50.924592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:50.924870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:50.925139 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:50.925799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:50.927729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:50.955515 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1418/2844] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:11:50 2022] POST /identity/v3/projects => generated 376 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:11:50.959681 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:50.969621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe061ba-611d-451c-9df4-22aa63508c3f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:51.024918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:51.025535 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:51.025820 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:51.026170 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:51.026813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:51.028728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:51.048923 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1427/2845] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:11:50 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:11:51.053054 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:51.064031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee14982-703d-44f9-bc2c-5da042a6df68 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:51.068668 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:51.069282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:51.069572 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:51.069851 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:51.070586 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:51.072822 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:51.082729 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1419/2846] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:11:51 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:11:51.086562 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:51.091941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:11:51.098123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02371-398e-4f95-8a65-9861e8d60d5e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:51.103946 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4db9f-eedd-4663-8e24-b65356ae8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:51.104549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4db9f-eedd-4663-8e24-b65356ae8ade admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:51.104828 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4db9f-eedd-4663-8e24-b65356ae8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:51.105101 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4db9f-eedd-4663-8e24-b65356ae8ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:51.105790 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4db9f-eedd-4663-8e24-b65356ae8ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:51.107435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4db9f-eedd-4663-8e24-b65356ae8ade admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:51.118220 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1428/2847] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:11:51 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:11:51.123006 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:51.133085 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c3f45-e8fb-4ee4-96a6-1024111328c8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:51.138383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:51.139044 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:51.139350 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:51.139632 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] PATH_INFO: `/v3/projects/e7f014c9323a4bc09a98afb85eb22e61/users/f65f18247ffe49ab9d907b8028c4dcbb/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:51.155472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f014c9323a4bc09a98afb85eb22e61, user_id=f65f18247ffe49ab9d907b8028c4dcbb, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:51.158266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:51.171824 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1420/2848] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:11:51 2022] PUT /identity/v3/projects/e7f014c9323a4bc09a98afb85eb22e61/users/f65f18247ffe49ab9d907b8028c4dcbb/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:11:51.182696 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54821-648c-4856-90c1-0311616cc546 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:51.182991 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54821-648c-4856-90c1-0311616cc546 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:51.183275 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54821-648c-4856-90c1-0311616cc546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:51.211114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-83f54821-648c-4856-90c1-0311616cc546 None None] MFA Rules not processed for user `f65f18247ffe49ab9d907b8028c4dcbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:11:51.212349 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83f54821-648c-4856-90c1-0311616cc546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:51.275749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1429/2849] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:11:51.287070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:11:51.288766 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:11:51.366644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb095d-7a3e-4210-848c-9eabc0aad337 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:11:51.370940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e8cb-dd3d-45aa-a226-9d0a115b02a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:11:51.371591 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e8cb-dd3d-45aa-a226-9d0a115b02a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:11:51.371877 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e8cb-dd3d-45aa-a226-9d0a115b02a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:11:51.372154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e8cb-dd3d-45aa-a226-9d0a115b02a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:11:51.380434 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741e8cb-dd3d-45aa-a226-9d0a115b02a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:11:51.381852 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741e8cb-dd3d-45aa-a226-9d0a115b02a5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:11:51.390678 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1421/2850] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:11:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:01.272537 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=36 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:01.386655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=66 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:02.780323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f54821-648c-4856-90c1-0311616cc546 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:02.843142 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f54821-648c-4856-90c1-0311616cc546 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:02.847749 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:02.848391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:02.848677 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:02.848956 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] PATH_INFO: `/v3/users/f65f18247ffe49ab9d907b8028c4dcbb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:02.850123 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65f18247ffe49ab9d907b8028c4dcbb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:02.852462 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:02.897899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65f18247ffe49ab9d907b8028c4dcbb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:02.905144 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65f18247ffe49ab9d907b8028c4dcbb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:02.917871 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65f18247ffe49ab9d907b8028c4dcbb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:02.918517 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65f18247ffe49ab9d907b8028c4dcbb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:02.919137 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65f18247ffe49ab9d907b8028c4dcbb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:02.932914 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1430/2851] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:12:02 2022] DELETE /identity/v3/users/f65f18247ffe49ab9d907b8028c4dcbb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:02.937418 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:02.937899 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:02.938005 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:02.956773 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:02.957991 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:03.017000 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1422/2852] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:03.027726 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.029179 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:03.089073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5009e7a-9228-4003-bb8d-3e958859c785 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.093006 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9eed5-5df2-4e11-9e77-044ea394b551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.093644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9eed5-5df2-4e11-9e77-044ea394b551 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.093929 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9eed5-5df2-4e11-9e77-044ea394b551 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.094207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9eed5-5df2-4e11-9e77-044ea394b551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.104596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9eed5-5df2-4e11-9e77-044ea394b551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.106090 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9eed5-5df2-4e11-9e77-044ea394b551 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.115647 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1431/2853] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:03.385321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.386872 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:03.401282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a0d8-de3b-490f-8a86-8c5af7558525 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.406496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.407163 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.407531 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.407699 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] PATH_INFO: `/v3/projects/e7f014c9323a4bc09a98afb85eb22e61` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.408854 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f014c9323a4bc09a98afb85eb22e61)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.410799 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.457602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f014c9323a4bc09a98afb85eb22e61', 'request_id': 'req-5302bb21-0413-4419-ba22-22d3a3faf663'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:03.463744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f014c9323a4bc09a98afb85eb22e61', 'request_id': 'req-5302bb21-0413-4419-ba22-22d3a3faf663'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:03.470979 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f014c9323a4bc09a98afb85eb22e61', 'request_id': 'req-5302bb21-0413-4419-ba22-22d3a3faf663'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:03.481608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] The token cache is being invalidate because project e7f014c9323a4bc09a98afb85eb22e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:12:03.481894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:03.482553 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5302bb21-0413-4419-ba22-22d3a3faf663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:03.484072 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1423/2854] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:12:03 2022] DELETE /identity/v3/projects/e7f014c9323a4bc09a98afb85eb22e61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:03.489051 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb97db3-99ed-4665-8213-15cab5333ac9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.489341 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb97db3-99ed-4665-8213-15cab5333ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.489619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb97db3-99ed-4665-8213-15cab5333ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.509629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-afb97db3-99ed-4665-8213-15cab5333ac9 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:03.510876 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-afb97db3-99ed-4665-8213-15cab5333ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:03.527944 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:03.572274 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1432/2855] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:03.638198 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11724c3d-86a9-40bd-b65c-51180533598c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.638633 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11724c3d-86a9-40bd-b65c-51180533598c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.639124 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11724c3d-86a9-40bd-b65c-51180533598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.660388 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-11724c3d-86a9-40bd-b65c-51180533598c None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:03.661616 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-11724c3d-86a9-40bd-b65c-51180533598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:03.670217 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1424/2856] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:03.674463 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb97db3-99ed-4665-8213-15cab5333ac9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.684287 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb97db3-99ed-4665-8213-15cab5333ac9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.688965 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.689615 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.689902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.690182 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.690921 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:12:03.691232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.692834 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.704483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1433/2857] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:12:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:12:03.708782 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11724c3d-86a9-40bd-b65c-51180533598c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.718644 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11724c3d-86a9-40bd-b65c-51180533598c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.724089 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.724704 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.725012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.725283 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.725943 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.728070 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.757189 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1425/2858] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:12:03 2022] POST /identity/v3/projects => generated 368 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:12:03.761525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.772049 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e44f24-ba8a-42d6-891c-c75ddb5fd91b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.830623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.831445 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.831559 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.831806 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.832490 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.834496 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.857629 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1434/2859] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:12:03 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:12:03.862018 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.872454 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad57b0-a4c0-4d99-94bf-a026e96f7c94 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.877130 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.877744 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.878031 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.878354 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.879063 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.880996 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.891265 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1426/2860] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:12:03 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 17:12:03.895281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.906355 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10059e-7390-4b62-a4f0-ae7aac7ed599 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.911033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908451a-dde6-43e5-bb33-9afd4e63087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.912019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908451a-dde6-43e5-bb33-9afd4e63087f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.912019 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908451a-dde6-43e5-bb33-9afd4e63087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.912232 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908451a-dde6-43e5-bb33-9afd4e63087f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.913435 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908451a-dde6-43e5-bb33-9afd4e63087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.914821 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908451a-dde6-43e5-bb33-9afd4e63087f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.926867 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1435/2861] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:12:03 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:12:03.931170 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:03.941053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bf337-b838-4d98-8901-5973e4c0f045 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:03.945800 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:03.946478 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.946757 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.947028 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] PATH_INFO: `/v3/projects/d7d427a6ab0d4aed8aaf5b9dece02e7f/users/2a88619bf743481c92f7b611253bfead/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:03.961654 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d427a6ab0d4aed8aaf5b9dece02e7f, user_id=2a88619bf743481c92f7b611253bfead, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:03.964865 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:03.977606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1427/2862] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:12:03 2022] PUT /identity/v3/projects/d7d427a6ab0d4aed8aaf5b9dece02e7f/users/2a88619bf743481c92f7b611253bfead/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:12:03.988294 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:03.988579 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:03.988854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:04.016646 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] MFA Rules not processed for user `2a88619bf743481c92f7b611253bfead`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:04.017849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:04.083805 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1436/2863] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:04.096459 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:04.098160 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:04.121332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:04.178306 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6163-7af4-43b0-8e28-3c9369835498 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:04.182362 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf25e3be640643c1a11fc21e08efdc70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:04.183492 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:04.183777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:04.184056 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:04.192439 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:04.193869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:04.203453 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1428/2864] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:14.080941 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:14.199173 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=17 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:27.822621 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:27.824545 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:27.921268 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5156ce4-401a-42eb-8780-746f1acfc515 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:27.926470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43868e-7c64-4b4c-a5b5-93df486114a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:27.927096 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43868e-7c64-4b4c-a5b5-93df486114a7 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:27.927383 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43868e-7c64-4b4c-a5b5-93df486114a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:27.927734 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43868e-7c64-4b4c-a5b5-93df486114a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:27.929550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a43868e-7c64-4b4c-a5b5-93df486114a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:27.942037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43868e-7c64-4b4c-a5b5-93df486114a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:27.943662 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43868e-7c64-4b4c-a5b5-93df486114a7 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:27.954417 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1437/2865] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:28.152832 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:28.221330 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3096a-983d-4974-af9b-4c6f8113e0bd service glance] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:28.229606 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:28.230625 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:28.231065 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:28.231509 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] PATH_INFO: `/v3/users/2a88619bf743481c92f7b611253bfead` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:28.233345 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a88619bf743481c92f7b611253bfead)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:28.235650 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:28.294030 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a88619bf743481c92f7b611253bfead'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.301772 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a88619bf743481c92f7b611253bfead'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.302544 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a88619bf743481c92f7b611253bfead'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.303311 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a88619bf743481c92f7b611253bfead'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.312103 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a88619bf743481c92f7b611253bfead'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.329291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1429/2866] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:12:28 2022] DELETE /identity/v3/users/2a88619bf743481c92f7b611253bfead => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:28.333822 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:28.334114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:28.334439 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:28.353671 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:28.354924 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:28.418858 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1438/2867] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:28.428634 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:28.430234 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:28.489270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd860703-c035-4f1c-9654-23d34c77f76d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:28.492978 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca5957-ad57-4f67-8565-d5accbb2d2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:28.493603 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5957-ad57-4f67-8565-d5accbb2d2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:28.493887 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5957-ad57-4f67-8565-d5accbb2d2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:28.494161 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5957-ad57-4f67-8565-d5accbb2d2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:28.505340 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca5957-ad57-4f67-8565-d5accbb2d2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:28.506861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca5957-ad57-4f67-8565-d5accbb2d2b7 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:28.516552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1430/2868] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:28.801704 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:28.803243 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:28.818163 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572c65a-a4ce-4562-aa82-7b57ef54920a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:28.824169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:28.825004 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:28.825093 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:28.825492 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] PATH_INFO: `/v3/projects/d7d427a6ab0d4aed8aaf5b9dece02e7f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:28.826815 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d427a6ab0d4aed8aaf5b9dece02e7f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:28.828743 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:28.876348 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d427a6ab0d4aed8aaf5b9dece02e7f', 'request_id': 'req-95c57c07-814b-4001-a016-e7ccaadbcdd6'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.882539 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d427a6ab0d4aed8aaf5b9dece02e7f', 'request_id': 'req-95c57c07-814b-4001-a016-e7ccaadbcdd6'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.890685 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d427a6ab0d4aed8aaf5b9dece02e7f', 'request_id': 'req-95c57c07-814b-4001-a016-e7ccaadbcdd6'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.894644 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:28.904143 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] The token cache is being invalidate because project d7d427a6ab0d4aed8aaf5b9dece02e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:12:28.904624 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.905547 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-95c57c07-814b-4001-a016-e7ccaadbcdd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:28.907236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1439/2869] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:12:28 2022] DELETE /identity/v3/projects/d7d427a6ab0d4aed8aaf5b9dece02e7f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:28.912205 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a03b7-b146-4b5c-b082-fd710d4185ff None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:28.912499 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a03b7-b146-4b5c-b082-fd710d4185ff None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:28.912777 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a03b7-b146-4b5c-b082-fd710d4185ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:28.933253 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e34a03b7-b146-4b5c-b082-fd710d4185ff None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:28.934449 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e34a03b7-b146-4b5c-b082-fd710d4185ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:28.951524 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:28.996848 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1431/2870] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:29.005154 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339804-9a76-4a1f-8d66-7624f2a779ef None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.005451 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339804-9a76-4a1f-8d66-7624f2a779ef None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.005737 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339804-9a76-4a1f-8d66-7624f2a779ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.027536 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-97339804-9a76-4a1f-8d66-7624f2a779ef None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:29.028825 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-97339804-9a76-4a1f-8d66-7624f2a779ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:29.037440 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1440/2871] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:12:29.042099 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a03b7-b146-4b5c-b082-fd710d4185ff None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:29.052602 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a03b7-b146-4b5c-b082-fd710d4185ff None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:29.057312 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:29.057914 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.058192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.058514 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.059203 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:12:29.059505 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:29.061088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:29.072393 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1432/2872] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:12:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 17:12:29.078855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339804-9a76-4a1f-8d66-7624f2a779ef None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:29.088356 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339804-9a76-4a1f-8d66-7624f2a779ef None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:29.093761 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:29.094400 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.094683 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.094958 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.095620 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:29.097529 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:29.124411 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1441/2873] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:12:29 2022] POST /identity/v3/projects => generated 386 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:12:29.128750 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:29.140537 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776c1fb-b8db-472f-900e-467142195d2c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:29.200067 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:29.200813 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.200919 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.201232 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.201902 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:29.203951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:29.225429 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1433/2874] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:12:29 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 17:12:29.229715 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:29.240365 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79365e5a-d48d-4c12-b4d9-597a1ac760b8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:29.245026 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:29.245633 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.245915 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.246191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.246919 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:29.248507 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:29.258327 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1442/2875] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:12:29 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:12:29.262710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:29.272670 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237955ef-9fa6-468b-bbb6-42b1884afc42 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:29.277831 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f315473-557f-444d-a6b8-ef78fd78a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:29.278479 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315473-557f-444d-a6b8-ef78fd78a48a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.278762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315473-557f-444d-a6b8-ef78fd78a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.279037 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f315473-557f-444d-a6b8-ef78fd78a48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.279730 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f315473-557f-444d-a6b8-ef78fd78a48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:29.281326 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f315473-557f-444d-a6b8-ef78fd78a48a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:29.292158 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1434/2876] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:12:29 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:12:29.296854 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:29.309091 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb094-59d2-4ff4-892d-ea0a9b5d9f4a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:29.313813 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:29.314515 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.314800 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.315075 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] PATH_INFO: `/v3/projects/67451aa611dd404ebe883a7149cf2613/users/f09c5284c1f443b686a2bf4fca40efb7/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.330543 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67451aa611dd404ebe883a7149cf2613, user_id=f09c5284c1f443b686a2bf4fca40efb7, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:29.333285 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:29.347412 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1443/2877] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:12:29 2022] PUT /identity/v3/projects/67451aa611dd404ebe883a7149cf2613/users/f09c5284c1f443b686a2bf4fca40efb7/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:12:29.357682 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6fa17-e61d-41c2-85e2-3fd48332128e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.357970 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6fa17-e61d-41c2-85e2-3fd48332128e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.358249 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6fa17-e61d-41c2-85e2-3fd48332128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.385192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c0c6fa17-e61d-41c2-85e2-3fd48332128e None None] MFA Rules not processed for user `f09c5284c1f443b686a2bf4fca40efb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:29.386936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c0c6fa17-e61d-41c2-85e2-3fd48332128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:29.453613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1435/2878] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:12:29.464849 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:29.466657 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:29.529916 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b90158-6568-44d0-b9ac-ba1a9360ca8c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:29.533674 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e46c-2791-400b-acd5-2dcaeec71767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:29.534336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e46c-2791-400b-acd5-2dcaeec71767 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:29.534623 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e46c-2791-400b-acd5-2dcaeec71767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:29.534902 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e46c-2791-400b-acd5-2dcaeec71767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:29.543594 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e46c-2791-400b-acd5-2dcaeec71767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:29.545037 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e46c-2791-400b-acd5-2dcaeec71767 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:29.554121 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1444/2879] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:32.180559 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6fa17-e61d-41c2-85e2-3fd48332128e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:32.199862 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:32.244012 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6fa17-e61d-41c2-85e2-3fd48332128e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:32.248555 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:32.249199 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:32.249484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:32.249765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] PATH_INFO: `/v3/users/f09c5284c1f443b686a2bf4fca40efb7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:32.250955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09c5284c1f443b686a2bf4fca40efb7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:32.252903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:32.301363 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09c5284c1f443b686a2bf4fca40efb7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.308390 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09c5284c1f443b686a2bf4fca40efb7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.309075 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09c5284c1f443b686a2bf4fca40efb7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.309686 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09c5284c1f443b686a2bf4fca40efb7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.317108 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09c5284c1f443b686a2bf4fca40efb7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.335735 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1436/2880] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:12:32 2022] DELETE /identity/v3/users/f09c5284c1f443b686a2bf4fca40efb7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:32.341100 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:32.341596 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:32.341716 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:32.361021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:32.362230 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:32.420138 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1445/2881] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:32.430196 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:32.431592 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:32.488185 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701c099-7471-49f3-88a9-0c354db014cb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:32.491903 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a7d4b-6184-4b6e-92a1-b771fcf0e538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:32.492520 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a7d4b-6184-4b6e-92a1-b771fcf0e538 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:32.492802 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a7d4b-6184-4b6e-92a1-b771fcf0e538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:32.493074 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a7d4b-6184-4b6e-92a1-b771fcf0e538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:32.502655 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a7d4b-6184-4b6e-92a1-b771fcf0e538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:32.504079 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a7d4b-6184-4b6e-92a1-b771fcf0e538 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:32.513908 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1437/2882] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:32.798904 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:32.800402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:32.816542 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639f3c7-b617-4094-b0eb-482ebcbf6ade None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:32.821352 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:32.822534 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:32.822988 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:32.823272 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] PATH_INFO: `/v3/projects/67451aa611dd404ebe883a7149cf2613` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:32.824586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=67451aa611dd404ebe883a7149cf2613)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:32.826586 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:32.858766 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:32.875241 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67451aa611dd404ebe883a7149cf2613', 'request_id': 'req-b4ff1998-4175-4f35-afe8-7c966b68ddbd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.881410 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67451aa611dd404ebe883a7149cf2613', 'request_id': 'req-b4ff1998-4175-4f35-afe8-7c966b68ddbd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.889774 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67451aa611dd404ebe883a7149cf2613', 'request_id': 'req-b4ff1998-4175-4f35-afe8-7c966b68ddbd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.901530 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] The token cache is being invalidate because project 67451aa611dd404ebe883a7149cf2613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:12:32.901817 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.902514 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b4ff1998-4175-4f35-afe8-7c966b68ddbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:32.904009 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1446/2883] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:12:32 2022] DELETE /identity/v3/projects/67451aa611dd404ebe883a7149cf2613 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:32.908890 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31c3f-bfe4-456a-a57c-1bf662e52e13 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:32.909279 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31c3f-bfe4-456a-a57c-1bf662e52e13 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:32.909554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31c3f-bfe4-456a-a57c-1bf662e52e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:32.929255 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f8a31c3f-bfe4-456a-a57c-1bf662e52e13 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:32.930413 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f8a31c3f-bfe4-456a-a57c-1bf662e52e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:32.964062 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:32.991825 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1438/2884] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:33.000178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc3656-9b69-49c2-bfbf-7343bca3f171 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.000483 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc3656-9b69-49c2-bfbf-7343bca3f171 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.000728 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc3656-9b69-49c2-bfbf-7343bca3f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.020188 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1cbc3656-9b69-49c2-bfbf-7343bca3f171 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:33.021660 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1cbc3656-9b69-49c2-bfbf-7343bca3f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:33.030983 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1447/2885] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:33.035460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a31c3f-bfe4-456a-a57c-1bf662e52e13 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:33.046270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a31c3f-bfe4-456a-a57c-1bf662e52e13 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:33.051023 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:33.051660 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.051944 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.052221 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.052925 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 17:12:33.053235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:33.054894 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:33.068270 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1439/2886] 10.222.0.121 () {58 vars in 1158 bytes} [Mon Aug 1 17:12:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 17:12:33.072676 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc3656-9b69-49c2-bfbf-7343bca3f171 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:33.082951 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc3656-9b69-49c2-bfbf-7343bca3f171 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:33.089281 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:33.089932 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.090218 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.090525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.091237 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:33.093225 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:33.127076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1448/2887] 10.222.0.121 () {60 vars in 1158 bytes} [Mon Aug 1 17:12:33 2022] POST /identity/v3/projects => generated 376 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:12:33.132834 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:33.143333 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d7d4-78d9-4804-99b6-258cf1f86100 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:33.205574 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:33.206460 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.206613 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.206866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.207525 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:33.209447 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:33.232589 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1440/2888] 10.222.0.121 () {60 vars in 1149 bytes} [Mon Aug 1 17:12:33 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 17:12:33.238591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:33.249833 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f4d52-d4e0-48bc-a731-a2c9f5709154 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:33.255767 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:33.256414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.256694 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.257054 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.257762 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:33.259402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:33.269981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1449/2889] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:12:33 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:12:33.274472 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:33.285521 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aea67-0b50-4bf4-b16d-281109c40ce5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:33.290477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7bc1f-c409-4cae-bd95-4d81856d84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:33.291104 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7bc1f-c409-4cae-bd95-4d81856d84f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.291384 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7bc1f-c409-4cae-bd95-4d81856d84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.291659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7bc1f-c409-4cae-bd95-4d81856d84f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.292381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7bc1f-c409-4cae-bd95-4d81856d84f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:33.294721 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7bc1f-c409-4cae-bd95-4d81856d84f0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:33.306224 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1441/2890] 10.222.0.121 () {58 vars in 1127 bytes} [Mon Aug 1 17:12:33 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 17:12:33.313990 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:33.325056 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437df0eb-8bef-4fd2-8d84-e690efc6b3dd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:33.330338 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:33.330885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.331169 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.331470 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] PATH_INFO: `/v3/projects/b3b7bd0e811844c1abf6f195604b63c7/users/ff5be611933d4243afb715c3e34ae508/roles/75e3e827b8d74897a0500ac1c262a078` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.351358 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b7bd0e811844c1abf6f195604b63c7, user_id=ff5be611933d4243afb715c3e34ae508, role_id=75e3e827b8d74897a0500ac1c262a078)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:33.354068 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:33.370619 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1450/2891] 10.222.0.121 () {60 vars in 1488 bytes} [Mon Aug 1 17:12:33 2022] PUT /identity/v3/projects/b3b7bd0e811844c1abf6f195604b63c7/users/ff5be611933d4243afb715c3e34ae508/roles/75e3e827b8d74897a0500ac1c262a078 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:33.382321 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc207e-bf53-4a68-a950-337787cbb452 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.382608 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc207e-bf53-4a68-a950-337787cbb452 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.382882 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc207e-bf53-4a68-a950-337787cbb452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.413980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-86dc207e-bf53-4a68-a950-337787cbb452 None None] MFA Rules not processed for user `ff5be611933d4243afb715c3e34ae508`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:33.415309 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-86dc207e-bf53-4a68-a950-337787cbb452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:33.478998 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1442/2892] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 17:12:33.493333 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:33.495158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:33.553052 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8b651-b1e0-4471-a4af-38cf79f09cbe admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:33.556746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb8e8-557b-4d92-a0ef-8a2083c68af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e9b1bcc6f8e4bbdacf66021bfe57bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:33.557367 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb8e8-557b-4d92-a0ef-8a2083c68af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:33.557654 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb8e8-557b-4d92-a0ef-8a2083c68af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:33.557933 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb8e8-557b-4d92-a0ef-8a2083c68af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:33.566288 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb8e8-557b-4d92-a0ef-8a2083c68af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:33.567731 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb8e8-557b-4d92-a0ef-8a2083c68af6 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:33.577172 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1451/2893] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:43.476080 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:43.500403 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc207e-bf53-4a68-a950-337787cbb452 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:43.572632 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=67,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:43.573178 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc207e-bf53-4a68-a950-337787cbb452 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:43.579154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:43.579845 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:43.580127 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:43.580397 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] PATH_INFO: `/v3/users/ff5be611933d4243afb715c3e34ae508` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:43.581598 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5be611933d4243afb715c3e34ae508)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:43.583539 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:43.637399 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5be611933d4243afb715c3e34ae508'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:43.645697 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5be611933d4243afb715c3e34ae508'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:43.646760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5be611933d4243afb715c3e34ae508'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:43.647368 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5be611933d4243afb715c3e34ae508'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:43.655793 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5be611933d4243afb715c3e34ae508'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:43.680657 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1443/2894] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:12:43 2022] DELETE /identity/v3/users/ff5be611933d4243afb715c3e34ae508 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:12:43.685601 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:43.685885 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:43.686158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:43.705899 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] MFA Rules not processed for user `754ebcbafca74603b46f7997fa570165`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:12:43.707158 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:43.776748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1452/2895] 10.222.0.121 () {58 vars in 963 bytes} [Mon Aug 1 17:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:12:43.787282 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:43.788740 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:43.856651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b87d08-8049-4580-a8cf-2b4b559ef619 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:43.860266 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747a1f2-0f06-4e34-9708-13b0a7bedeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:43.860892 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a1f2-0f06-4e34-9708-13b0a7bedeeb service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:43.861174 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a1f2-0f06-4e34-9708-13b0a7bedeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:43.861452 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a1f2-0f06-4e34-9708-13b0a7bedeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:43.871052 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a1f2-0f06-4e34-9708-13b0a7bedeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:43.872494 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a1f2-0f06-4e34-9708-13b0a7bedeeb service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:43.885057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1444/2896] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:12:44.184659 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:12:44.186280 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:12:44.199981 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f87bb6-ad70-48db-bb8d-f014686f96c5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:12:44.204666 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:12:44.205312 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:12:44.205591 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:12:44.205901 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] PATH_INFO: `/v3/projects/b3b7bd0e811844c1abf6f195604b63c7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:12:44.207141 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b7bd0e811844c1abf6f195604b63c7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:12:44.209185 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:12:44.258571 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b7bd0e811844c1abf6f195604b63c7', 'request_id': 'req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:44.265441 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b7bd0e811844c1abf6f195604b63c7', 'request_id': 'req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:44.273276 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b7bd0e811844c1abf6f195604b63c7', 'request_id': 'req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:44.285296 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] The token cache is being invalidate because project b3b7bd0e811844c1abf6f195604b63c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:12:44.285585 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:44.286209 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:12:44.287788 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1453/2897] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:12:44 2022] DELETE /identity/v3/projects/b3b7bd0e811844c1abf6f195604b63c7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:12:53.877987 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:12:54.282323 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:13:10.008428 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:10.008964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:10.008964 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:10.040762 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] MFA Rules not processed for user `1037da4d8e26461abaed2fb3fce7e81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 17:13:10.042053 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:10.104980 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1445/2898] 10.222.0.121 () {58 vars in 972 bytes} [Mon Aug 1 17:13:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 17:13:10.148028 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:10.149503 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:10.223304 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d2d6d-9417-4fb7-975f-a5ce1f1e884e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:10.229649 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b0b0e563f46c693361b1f9bfc66d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:10.230310 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:10.230606 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:10.230890 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:10.240245 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:10.241811 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:10.250414 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1454/2899] 10.222.0.121 () {60 vars in 1389 bytes} [Mon Aug 1 17:13:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 17:13:16.886636 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:16.888119 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:16.968153 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f43f0-3161-4e5d-b8cb-44adba324ad0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:16.973529 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:16.974202 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:16.974558 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:16.974842 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] PATH_INFO: `/v3/users/acdb3d3fc96b45b197ea0f22c4e763f9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:16.976043 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdb3d3fc96b45b197ea0f22c4e763f9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:16.977951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:17.024186 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdb3d3fc96b45b197ea0f22c4e763f9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.031039 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdb3d3fc96b45b197ea0f22c4e763f9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.031710 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdb3d3fc96b45b197ea0f22c4e763f9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.032334 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdb3d3fc96b45b197ea0f22c4e763f9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.040227 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdb3d3fc96b45b197ea0f22c4e763f9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.057480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1446/2900] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:13:16 2022] DELETE /identity/v3/users/acdb3d3fc96b45b197ea0f22c4e763f9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:13:17.239538 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:17.263581 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce47c3-9d49-4148-a666-9cb55b0c359d service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:17.327181 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:17.327895 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:17.328178 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:17.328456 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] PATH_INFO: `/v3/projects/5a970e3f256a46258c5dc401477967b8` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:17.330478 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a970e3f256a46258c5dc401477967b8)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:17.332430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:17.379025 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a970e3f256a46258c5dc401477967b8', 'request_id': 'req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.385207 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a970e3f256a46258c5dc401477967b8', 'request_id': 'req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.394035 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a970e3f256a46258c5dc401477967b8', 'request_id': 'req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.405033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] The token cache is being invalidate because project 5a970e3f256a46258c5dc401477967b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:13:17.405326 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.405957 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.407489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1455/2901] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:13:17 2022] DELETE /identity/v3/projects/5a970e3f256a46258c5dc401477967b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:13:17.411551 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:17.413484 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:17.427168 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614df92-c0ab-4acf-a6c0-56c70f85e0a0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:17.438601 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:13:17.485477 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:17.486155 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:17.486470 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:17.486751 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] PATH_INFO: `/v3/users/eeb5554ebda247fd93699e47cffdcfb0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:17.487936 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb5554ebda247fd93699e47cffdcfb0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:17.490381 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:17.538900 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb5554ebda247fd93699e47cffdcfb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.546728 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb5554ebda247fd93699e47cffdcfb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.547455 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb5554ebda247fd93699e47cffdcfb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.548068 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb5554ebda247fd93699e47cffdcfb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.555760 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb5554ebda247fd93699e47cffdcfb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.573331 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1447/2902] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:13:17 2022] DELETE /identity/v3/users/eeb5554ebda247fd93699e47cffdcfb0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:13:17.749109 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:17.751402 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:17.774561 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8a5af-130b-47cf-82fb-1783d7b0e6e7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:17.798206 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:13:17.843549 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:17.844221 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:17.844504 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:17.844778 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] PATH_INFO: `/v3/projects/d065b680d0f64134b21eed3b1d1b3708` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:17.846032 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d065b680d0f64134b21eed3b1d1b3708)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:17.848021 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:17.902669 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd065b680d0f64134b21eed3b1d1b3708', 'request_id': 'req-c690f23a-1731-4ea1-aed8-6e4efc8262b3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.908954 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd065b680d0f64134b21eed3b1d1b3708', 'request_id': 'req-c690f23a-1731-4ea1-aed8-6e4efc8262b3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.916985 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd065b680d0f64134b21eed3b1d1b3708', 'request_id': 'req-c690f23a-1731-4ea1-aed8-6e4efc8262b3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.927949 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] The token cache is being invalidate because project d065b680d0f64134b21eed3b1d1b3708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:13:17.928228 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.928855 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:13:17.930391 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1456/2903] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:13:17 2022] DELETE /identity/v3/projects/d065b680d0f64134b21eed3b1d1b3708 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:13:25.625961 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:25.627497 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:25.687364 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067e8be-215c-4455-9dad-0418a101e145 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:25.738861 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:25.739496 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:25.739779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:25.740057 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:25.741951 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:25.746567 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:13:25.814928 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:25.816378 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:25.827410 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1448/2904] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:13:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:13:27.924930 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:13:29.452343 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:29.454128 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:29.466792 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690f23a-1731-4ea1-aed8-6e4efc8262b3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:29.470450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:29.471072 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:29.471354 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:29.471636 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:29.473963 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:29.491084 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:29.494713 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:29.505073 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1457/2905] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:13:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:13:29.583383 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:29.592869 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a0f84-092a-4e8b-91ad-55c644421ae5 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:29.596491 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:29.597114 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:29.597396 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:29.597672 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:29.599988 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:29.614677 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:29.616192 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:29.627722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1449/2906] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:13:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:13:31.841199 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:13:31.850739 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c5d07-0120-4a99-816b-639c3cd6169b service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:13:31.854748 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:13:31.855710 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:13:31.856102 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:13:31.856491 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:13:31.858525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:13:31.873707 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:13:31.875191 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:13:31.890438 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1458/2907] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:13:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:13:39.622607 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=37 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:13:41.882239 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=12 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:28.456722 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:14:28.458154 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:14:28.468828 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69018096-dd00-4503-8183-ca0df741e2e7 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:14:28.472501 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '112c65065f6d4c5990f3952e0099cb54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:14:28.473107 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:14:28.473391 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:14:28.473659 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:14:28.475780 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:14:28.490027 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:14:28.499302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:14:28.507829 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1450/2908] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:14:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:14:38.503826 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:14:54.309511 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:14:54.314415 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:14:54.341595 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b0f1-c97a-437a-8a7f-e2d4bbe791cd service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:14:54.348263 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3215124493472d89807ab5845258fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:14:54.349278 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:14:54.349489 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:14:54.349698 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:14:54.352238 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:14:54.367114 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:14:54.370027 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:14:54.385653 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1459/2909] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:15:01.682554 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:15:01.684332 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:15:01.792244 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649bfd-d3b1-4994-b6ee-6b7b3a9a7ffe service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:15:01.797870 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:15:01.798552 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:15:01.799048 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:15:01.799328 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:15:01.801295 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:15:01.819147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:15:01.821088 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:15:01.834511 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1451/2910] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:15:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:15:04.380745 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:05.375572 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:15:05.390714 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87b4ab-aeff-465c-901d-050710102855 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:15:05.399779 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:15:05.400564 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:15:05.401301 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:15:05.401803 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:15:05.404044 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:15:05.423336 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:15:05.426279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:15:05.439759 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1460/2911] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:15:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:15:05.468723 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:15:05.472600 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:15:05.572783 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78770ed4-468f-47fb-84b0-24c583abff44 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:15:05.577462 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:15:05.578110 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:15:05.578425 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:15:05.578701 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] PATH_INFO: `/v3/users/8a997907345b4a4cad3e4708e9f344a7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:15:05.579866 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a997907345b4a4cad3e4708e9f344a7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:15:05.581797 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:15:05.642424 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a997907345b4a4cad3e4708e9f344a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:05.649950 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a997907345b4a4cad3e4708e9f344a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:05.651036 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a997907345b4a4cad3e4708e9f344a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:05.651640 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a997907345b4a4cad3e4708e9f344a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:05.667779 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a997907345b4a4cad3e4708e9f344a7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:05.694316 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1452/2912] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:15:05 2022] DELETE /identity/v3/users/8a997907345b4a4cad3e4708e9f344a7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:15:05.935252 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:15:05.950132 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d00f2-bfd5-4f51-aa47-39b59ab89a13 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:15:06.032002 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:15:06.032693 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:15:06.032986 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:15:06.033267 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] PATH_INFO: `/v3/projects/fc42cd8ac70e40fc9f1ce4efc46db682` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:15:06.034550 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc42cd8ac70e40fc9f1ce4efc46db682)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:15:06.036525 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:15:06.093918 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc42cd8ac70e40fc9f1ce4efc46db682', 'request_id': 'req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.100889 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc42cd8ac70e40fc9f1ce4efc46db682', 'request_id': 'req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.111033 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc42cd8ac70e40fc9f1ce4efc46db682', 'request_id': 'req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.124510 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] The token cache is being invalidate because project fc42cd8ac70e40fc9f1ce4efc46db682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:15:06.124842 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.125603 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.127378 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1461/2913] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:15:05 2022] DELETE /identity/v3/projects/fc42cd8ac70e40fc9f1ce4efc46db682 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:15:06.132775 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:15:06.134291 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:15:06.153144 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06b361-da2a-463e-aa99-a046cdafad1d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:15:06.159436 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:06.227628 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:15:06.228615 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:15:06.229050 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:15:06.229480 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] PATH_INFO: `/v3/users/f04f69e052bf491ea21cc497485a6cfa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:15:06.231526 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04f69e052bf491ea21cc497485a6cfa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:15:06.235147 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:15:06.298725 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04f69e052bf491ea21cc497485a6cfa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.308235 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04f69e052bf491ea21cc497485a6cfa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.308955 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04f69e052bf491ea21cc497485a6cfa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.309765 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04f69e052bf491ea21cc497485a6cfa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.321275 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04f69e052bf491ea21cc497485a6cfa'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.340605 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1453/2914] 10.222.0.121 () {58 vars in 1229 bytes} [Mon Aug 1 17:15:06 2022] DELETE /identity/v3/users/f04f69e052bf491ea21cc497485a6cfa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 17:15:06.538319 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:15:06.539947 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:15:06.560628 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecff1d-c5bf-4a4c-b3ab-84fce52e7b6d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:15:06.628450 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ebcbafca74603b46f7997fa570165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af3932992b7744cba48da1d3cbe4b99c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:15:06.629753 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:15:06.630236 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:15:06.631076 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] PATH_INFO: `/v3/projects/7771895c1a7b4e4183dbb2da92a898de` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:15:06.631936 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7771895c1a7b4e4183dbb2da92a898de)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:15:06.634574 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:15:06.661701 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:06.700157 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7771895c1a7b4e4183dbb2da92a898de', 'request_id': 'req-f7a4bbe6-fbb7-4527-af19-0c8856426380'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.707982 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7771895c1a7b4e4183dbb2da92a898de', 'request_id': 'req-f7a4bbe6-fbb7-4527-af19-0c8856426380'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.718870 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7771895c1a7b4e4183dbb2da92a898de', 'request_id': 'req-f7a4bbe6-fbb7-4527-af19-0c8856426380'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.736746 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] The token cache is being invalidate because project 7771895c1a7b4e4183dbb2da92a898de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 17:15:06.737279 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.738396 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f7a4bbe6-fbb7-4527-af19-0c8856426380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 17:15:06.741034 dv-cinder-850321-2-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1462/2915] 10.222.0.121 () {58 vars in 1238 bytes} [Mon Aug 1 17:15:06 2022] DELETE /identity/v3/projects/7771895c1a7b4e4183dbb2da92a898de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 17:15:16.336999 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:15:16.732430 dv-cinder-850321-2-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 17:17:34.773810 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 17:17:34.775349 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:17:34.858891 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848208ba-48d8-4561-a840-47d65e886313 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 17:17:34.921930 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05f2da-f3d3-4e08-a9c0-b7ace54bb956 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb75b9333bf47328ac86c259b34becc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e78955e6f0d4975a9c3886a28f8b321', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 17:17:34.922651 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05f2da-f3d3-4e08-a9c0-b7ace54bb956 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 17:17:34.922940 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05f2da-f3d3-4e08-a9c0-b7ace54bb956 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 17:17:34.923302 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05f2da-f3d3-4e08-a9c0-b7ace54bb956 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 17:17:34.925341 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2f05f2da-f3d3-4e08-a9c0-b7ace54bb956 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 17:17:34.939111 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05f2da-f3d3-4e08-a9c0-b7ace54bb956 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 17:17:34.940687 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05f2da-f3d3-4e08-a9c0-b7ace54bb956 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 17:17:34.951432 dv-cinder-850321-2-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1454/2916] 10.222.0.121 () {60 vars in 1370 bytes} [Mon Aug 1 17:17:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 17:17:44.946580 dv-cinder-850321-2-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=58 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}